Sep 07 16:49:18 devstack cinder-volume[75814]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:49:18 devstack cinder-volume[75814]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:49:18 devstack cinder-volume[75814]: we strongly recommend against using it for new projects. Sep 07 16:49:18 devstack cinder-volume[75814]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:49:18 devstack cinder-volume[75814]: framework. For more detail see Sep 07 16:49:18 devstack cinder-volume[75814]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:49:18 devstack cinder-volume[75814]: import eventlet # noqa Sep 07 16:49:21 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:49:21 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:49:21 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:49:22 devstack cinder-volume[75814]: INFO dbcounter [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Registered counter for database cinder Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG oslo_db.sqlalchemy.engines [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG dbcounter [-] [75814] Writer thread running {{(pid=75814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:49:22 devstack cinder-volume[75814]: INFO cinder.rpc [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:49:22 devstack cinder-volume[75814]: INFO cinder.rpc [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG oslo_db.sqlalchemy.engines [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:49:22 devstack cinder-volume[75814]: INFO cinder.volume.manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Determined volume DB was empty at startup. Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG cinder.volume.manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75814) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:49:22 devstack cinder-volume[75814]: INFO cinder.volume.manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 16:49:22 devstack cinder-volume[75814]: WARNING stevedore.named [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:49:22 devstack cinder-volume[75814]: WARNING castellan.key_manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:49:22 devstack cinder-volume[75814]: WARNING cinder.keymgr.conf_key_mgr [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG cinder.volume.drivers.lvm [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75814) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 16:49:22 devstack cinder-volume[75814]: DEBUG oslo_concurrency.processutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75814) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_concurrency.processutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] CMD "cinder-rtstool verify" returned: 0 in 0.411s {{(pid=75814) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_db.sqlalchemy.engines [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:49:23 devstack cinder-volume[75814]: INFO cinder.rpc [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 16:49:23 devstack cinder-volume[75814]: INFO cinder.rpc [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 16:49:23 devstack cinder-volume[75814]: WARNING stevedore.named [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:49:23 devstack cinder-volume[75814]: WARNING castellan.key_manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:49:23 devstack cinder-volume[75814]: INFO cinder.volume.manager [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_db.sqlalchemy.engines [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75814) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:49:23 devstack cinder-volume[75814]: INFO oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Starting 1 workers Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Started child 75996 {{(pid=75814) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Full set of CONF: {{(pid=75814) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] ******************************************************************************** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Configuration options gathered from: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] ================================================================================ {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:49:23 devstack cinder-volume[75996]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] allow_availability_zone_fallback = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] allow_compression_on_image_upload = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] allowed_direct_url_schemes = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] api_rate_limit = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] auth_strategy = keystone {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] az_cache_duration = 3600 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_availability_zone = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_host = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_stats_polling_interval = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backup_api_class = cinder.backup.api.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backup_name_template = backup-%s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backup_use_same_host = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backup_use_temp_snapshot = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] chap_password = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] chap_username = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_internal_tenant_project_id = 195eb4a91ea2444a82139f63ec552c47 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_internal_tenant_user_id = 926dea2953f14266b2de46f70fbebb04 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cloned_volume_same_az = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cluster = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] compression_format = gzip {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] compute_api_class = cinder.compute.nova.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] config_dir = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] config_source = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] control_exchange = openstack {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] debug = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] default_availability_zone = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] default_group_type = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] default_volume_type = lvmdriver-1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] disk_geometry = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_client_cert = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_client_cert_key = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_data_namespace = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_ssl_cert_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_ssl_cert_verify = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] driver_use_ssl = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] enable_force_upload = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] enable_new_services = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] enable_unsupported_driver = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] enforce_multipath_for_image_xfer = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] filter_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_api_insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_api_ssl_compression = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_ca_certificates_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_catalog_info = image:glance:publicURL {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_num_retries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance_request_timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] goodness_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] graceful_shutdown_timeout = 5 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] group_api_class = cinder.group.api.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] host = devstack {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_compress_on_upload = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_conversion_address_space_limit = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_conversion_cpu_limit = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_conversion_disable = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_upload_use_cinder_backend = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_upload_use_internal_tenant = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_volume_cache_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_volume_cache_max_count = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] image_volume_cache_max_size_gb = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] init_host_max_objects_retrieval = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] instance_format = [instance: %(uuid)s] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iscsi_target_flags = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iscsi_write_cache = on {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iser_helper = tgtadm {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iser_ip_address = 192.168.122.80 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iser_port = 3260 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_color = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_config_append = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_dir = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_options = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_rotate_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_rotate_interval_type = days {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] log_rotation_type = none {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] max_age = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] max_logfile_count = 30 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] max_logfile_size_mb = 200 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] max_over_subscription_ratio = 20.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] message_reap_interval = 86400 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] message_ttl = 2592000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] migration_create_volume_timeout_secs = 300 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] monkey_patch = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] monkey_patch_modules = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] my_ip = 192.168.122.80 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] no_snapshot_gb_quota = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] num_iser_scan_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] num_shell_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] num_volume_device_scan_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] nvmeof_conn_info_version = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] nvmet_ns_id = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] nvmet_port_id = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_max_limit = 1000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_ext_list = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_listen_port = 8776 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_use_ssl = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] osapi_volume_workers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] per_volume_size_limit = -1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] periodic_fuzzy_delay = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] periodic_interval = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] public_endpoint = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] publish_errors = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_backup_gigabytes = 1000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_backups = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_gigabytes = 1000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_groups = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_snapshots = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] quota_volumes = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] rate_limit_burst = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] rate_limit_except_level = CRITICAL {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] rate_limit_interval = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] reinit_driver_count = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] replication_device = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] report_discard_supported = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] report_interval = 120 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] reservation_clean_interval = 86400 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] reservation_expire = 86400 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] reserved_image_namespaces = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] reserved_percentage = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] rpc_response_timeout = 120 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] run_external_periodic_tasks = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] scst_target_driver = iscsi {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] scst_target_iqn_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_down_time = 720 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] shell_completion = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] snapshot_name_template = snapshot-%s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] snapshot_same_host = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] split_loggers = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] state_path = /opt/stack/data/cinder {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] storage_availability_zone = nova {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] storage_protocol = iSCSI {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] syslog_log_facility = LOG_USER {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_helper = lioadm {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_ip_address = 192.168.122.80 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_port = 3260 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_protocol = iscsi {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] target_secondary_ip_addresses = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] trace_flags = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] transport_url = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] until_refresh = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_chap_auth = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_default_quota_class = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_journal = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_json = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_multipath_for_image_xfer = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_stderr = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] use_syslog = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] verify_glance_signatures = enabled {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_api_class = cinder.volume.api.API {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_backend_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_clear = zero {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_clear_ionice = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_clear_size = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_copy_bps_limit = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_dd_blocksize = 1M {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_name_template = volume-%s {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_service_inithost_offload = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volume_usage_audit_period = month {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] zoning_mode = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_concurrency.disable_process_locking = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.auth_section = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.auth_type = password {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.auth_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.cache = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.include_service_catalog = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.interface = public {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_password = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcache_username = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.region_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.service_type = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.backend = dogpile.cache.null {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.backend_argument = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.backend_expiration_time = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.config_prefix = cache.oslo {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.debug_cache_backend = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.enable_retry_client = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.enable_socket_keepalive = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.expiration_time = 600 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack sudo[76056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.hashclient_retry_attempts = 2 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack sudo[76056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_dead_retry = 300 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_pool_maxsize = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_sasl_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.password = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.proxies = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.redis_db = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.redis_server = localhost:6379 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.retry_attempts = 2 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.retry_delay = 0.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.socket_keepalive_count = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.socket_keepalive_idle = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.socket_keepalive_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.socket_timeout = 1.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.tls_allowed_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.tls_cafile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.tls_certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.tls_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.tls_keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cache.username = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] coordination.backend_url = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.asyncio_connection = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.asyncio_slave_connection = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.backend = sqlalchemy {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.connection = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.connection_debug = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.connection_parameters = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.connection_recycle_time = 3600 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.connection_trace = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.db_inc_retry_interval = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.db_max_retries = 20 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.db_max_retry_interval = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.db_retry_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.max_overflow = 50 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.max_pool_size = 5 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.max_retries = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.mysql_wsrep_sync_wait = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.pool_timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.retry_interval = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.slave_connection = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.sqlite_synchronous = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.synchronous_reader = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] database.use_db_reconnect = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_tracing.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.connection_string = messaging:// {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.es_doc_type = notification {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.es_scroll_size = 10000 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.es_scroll_time = 2m {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.filter_error_trace = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.hmac_keys = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.sentinel_service_name = mymaster {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.socket_timeout = 0.1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.trace_requests = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler.trace_sqlalchemy = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler_jaeger.process_tags = {} {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler_jaeger.service_name_prefix = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] profiler_otlp.service_name_prefix = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.enforce_new_defaults = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.policy_default_rule = default {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.policy_file = policy.yaml {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.group = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.helper_command = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] privsep_osbrick.user = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.group = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.helper_command = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] cinder_sys_admin.user = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.auth_section = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.auth_type = password {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.cafile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.collect_timing = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.send_service_user_token = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.split_loggers = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.tls_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] service_user.tls_min_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.auth_section = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.auth_type = password {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.collect_timing = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.region_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.split_loggers = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.tls_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] glance.tls_min_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.backend_availability_zone = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.chap_password = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.chap_username = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.disk_geometry = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_client_cert = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_client_cert_key = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_data_namespace = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.driver_use_ssl = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.extra_capabilities = {} {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.filter_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.goodness_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iscsi_target_flags = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iscsi_write_cache = on {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iser_helper = tgtadm {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iser_port = 3260 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.lvm_share_target = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.lvm_type = auto {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.num_shell_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.replication_device = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.report_discard_supported = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.reserved_percentage = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_helper = tgtadm {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_port = 3260 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_protocol = iscsi {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.trace_flags = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.unique_fqdn_network = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.use_chap_auth = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_backend_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_clear = zero {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_clear_ionice = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_clear_size = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_reports.file_event_handler = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_reports.log_dir = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.backend_host = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.chap_password = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.chap_username = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.disk_geometry = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_client_cert = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.extra_capabilities = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.filter_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.goodness_function = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iser_helper = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iser_ip_address = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iser_port = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.lvm_share_target = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.lvm_type = auto {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.num_shell_tries = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.replication_device = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.report_discard_supported = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.reserved_percentage = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.scst_target_driver = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.storage_protocol = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_helper = lioadm {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_ip_address = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_port = 3260 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.trace_flags = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.use_chap_auth = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:23 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_clear = zero {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_clear_size = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] lvmdriver-1.volumes_dir = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_notifications.driver = [] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_notifications.retry = -1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] key_manager.fixed_key = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.barbican_api_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.barbican_endpoint = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.barbican_endpoint_type = public {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.barbican_region_name = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.cafile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.collect_timing = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.number_of_retries = 60 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.retry_delay = 1 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.send_service_user_token = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.split_loggers = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.tls_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.tls_min_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.verify_ssl = True {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican.verify_ssl_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.auth_section = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.auth_type = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.cafile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.certfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.collect_timing = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.insecure = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.keyfile = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.split_loggers = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.timeout = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.tls_ciphers = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] barbican_service_user.tls_min_version = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.approle_role_id = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.approle_secret_id = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.auth_method = approle {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.auth_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.kv_mountpoint = secret {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.kv_path = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.kv_version = 2 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.namespace = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.root_token_id = **** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.ssl_ca_crt_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.timeout = 60.0 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.token_file = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.token_role = None {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.use_ssl = False {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:49:24 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] ******************************************************************************** {{(pid=75814) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:49:24 devstack sudo[76056]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.401s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:24 devstack sudo[76190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:24 devstack sudo[76190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:24 devstack sudo[76190]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.304s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:49:24 devstack cinder-volume[75996]: INFO cinder.brick.local_dev.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:24 devstack sudo[76289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:24 devstack sudo[76289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:24 devstack sudo[76289]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG cinder.brick.local_dev.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75996) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 16:49:24 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:24 devstack sudo[76376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:24 devstack sudo[76376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:25 devstack sudo[76376]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.534s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack sudo[76608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:25 devstack sudo[76608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:25 devstack sudo[76608]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack sudo[76612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 16:49:25 devstack sudo[76612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:25 devstack sudo[76612]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.273s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:25 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:25 devstack sudo[76693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:25 devstack sudo[76693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:26 devstack sudo[76693]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack sudo[76699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:26 devstack sudo[76699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:26 devstack sudo[76699]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack sudo[76708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:26 devstack sudo[76708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:26 devstack sudo[76708]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack sudo[76791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:26 devstack sudo[76791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:26 devstack sudo[76791]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:26 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:26 devstack sudo[76795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:26 devstack sudo[76795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:27 devstack sudo[76795]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.299s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:27 devstack cinder-volume[75996]: INFO cinder.volume.drivers.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:27 devstack sudo[76799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:27 devstack sudo[76799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:27 devstack sudo[76799]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:27 devstack sudo[76808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:27 devstack sudo[76808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:27 devstack sudo[76808]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:27 devstack sudo[76811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:27 devstack sudo[76811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:27 devstack sudo[76811]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:27 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:28 devstack sudo[76814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:28 devstack sudo[76814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:28 devstack sudo[76814]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:28 devstack sudo[76817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:28 devstack sudo[76817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:28 devstack sudo[76817]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:28 devstack cinder-volume[75996]: INFO cinder.volume.driver [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG cinder.volume.driver [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75996) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_db.sqlalchemy.engines [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75996) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writer thread running {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG cinder.db.api [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Building query based on filter {{(pid=75996) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG cinder.image.image_utils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75996) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:49:28 devstack cinder-volume[75996]: INFO cinder.keymgr.migration [None req-a28a0d18-a8ab-4a43-88db-49b3f48149e5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:28 devstack sudo[76821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:28 devstack sudo[76821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:28 devstack sudo[76821]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:28 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:28 devstack sudo[76825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:28 devstack sudo[76825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:29 devstack sudo[76825]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.286s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:29 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:29 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:29 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:29 devstack sudo[76832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:29 devstack sudo[76832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:29 devstack sudo[76832]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG cinder.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Notifying Schedulers of capabilities ... {{(pid=75996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:49:29 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Driver initialization completed successfully. Sep 07 16:49:29 devstack cinder-volume[75996]: INFO cinder.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Initiating service 2 cleanup Sep 07 16:49:29 devstack cinder-volume[75996]: INFO cinder.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Service 2 cleanup completed. Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG cinder.service [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Creating RPC server for service cinder-volume {{(pid=75996) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG cinder.service [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75996) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:49:29 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:49:29 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:29 devstack sudo[76835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:49:29 devstack sudo[76835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:30 devstack sudo[76835]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:30 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:30 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:30 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:30 devstack sudo[76846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:49:30 devstack sudo[76846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:30 devstack sudo[76846]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.311s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:49:30 devstack sudo[76849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:49:30 devstack sudo[76849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:49:30 devstack sudo[76849]: pam_unix(sudo:session): session closed for user root Sep 07 16:49:30 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:49:31 devstack cinder-volume[75996]: INFO cinder.volume.manager [None req-4e2bdb14-5691-4ffa-9497-9233633030ce None None] Driver post RPC initialization completed successfully. Sep 07 16:49:33 devstack cinder-volume[75814]: DEBUG dbcounter [-] [75814] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75814) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:49:40 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=3 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:49:41 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:49:43 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager._thread_info {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:49:43 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread count: 6 {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:49:43 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread info: [<_MainThread(MainThread, started 123622554996864)>, , , , , ] {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:43 devstack sudo[79224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:50:43 devstack sudo[79224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:43 devstack sudo[79224]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:43 devstack sudo[79228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:50:43 devstack sudo[79228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:43 devstack sudo[79228]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:43 devstack sudo[79232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:50:43 devstack sudo[79232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:43 devstack sudo[79232]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:50:43 devstack sudo[79290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:50:43 devstack sudo[79290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:50:44 devstack sudo[79290]: pam_unix(sudo:session): session closed for user root Sep 07 16:50:44 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:50:44 devstack cinder-volume[75996]: DEBUG cinder.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Notifying Schedulers of capabilities ... {{(pid=75996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:50:44 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager._thread_info {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:50:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread count: 6 {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:50:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread info: [<_MainThread(MainThread, started 123622554996864)>, , , , , ] {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:51:41 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:51:41 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:UPDATE=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:43 devstack sudo[82450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:51:43 devstack sudo[82450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:43 devstack sudo[82450]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:43 devstack sudo[82461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:51:43 devstack sudo[82461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:43 devstack sudo[82461]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:43 devstack sudo[82470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:51:43 devstack sudo[82470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:43 devstack sudo[82470]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:51:43 devstack sudo[82474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:51:43 devstack sudo[82474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:51:44 devstack sudo[82474]: pam_unix(sudo:session): session closed for user root Sep 07 16:51:44 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:51:44 devstack cinder-volume[75996]: DEBUG cinder.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Notifying Schedulers of capabilities ... {{(pid=75996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:51:44 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager._thread_info {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:51:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread count: 6 {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:51:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread info: [<_MainThread(MainThread, started 123622554996864)>, , , , , ] {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:43 devstack sudo[84668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:52:43 devstack sudo[84668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:43 devstack sudo[84668]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:43 devstack sudo[84673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:52:43 devstack sudo[84673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:43 devstack sudo[84673]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:43 devstack sudo[84679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:52:43 devstack sudo[84679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:43 devstack sudo[84679]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:52:43 devstack sudo[84700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:52:43 devstack sudo[84700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:52:44 devstack sudo[84700]: pam_unix(sudo:session): session closed for user root Sep 07 16:52:44 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:52:44 devstack cinder-volume[75996]: DEBUG cinder.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Notifying Schedulers of capabilities ... {{(pid=75996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:52:44 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager._thread_info {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:52:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread count: 6 {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:52:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread info: [<_MainThread(MainThread, started 123622554996864)>, , , , , ] {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:53:41 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:SELECT=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:53:41 devstack cinder-volume[75996]: DEBUG dbcounter [-] [75996] Writing DB stats cinder:UPDATE=1 {{(pid=75996) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG cinder.volume.drivers.lvm [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Updating volume stats {{(pid=75996) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 16:53:43 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:53:43 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 16:53:43 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:43 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.270s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:43 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:43 devstack sudo[85871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 16:53:43 devstack sudo[85871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:44 devstack sudo[85871]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:44 devstack cinder-volume[75996]: DEBUG oslo_concurrency.processutils [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75996) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:44 devstack cinder-volume[75996]: DEBUG cinder.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Notifying Schedulers of capabilities ... {{(pid=75996) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:44 devstack cinder-volume[75996]: DEBUG oslo_service.periodic_task [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] Running periodic task VolumeManager._thread_info {{(pid=75996) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:53:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread count: 6 {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:53:44 devstack cinder-volume[75996]: DEBUG cinder.volume.manager [None req-2b6d61a4-721f-4415-b9de-25f22e42da81 None None] thread info: [<_MainThread(MainThread, started 123622554996864)>, , , , , ] {{(pid=75996) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:53:45 devstack cinder-volume[75814]: INFO oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Caught SIGTERM, stopping children Sep 07 16:53:45 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Acquiring lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:53:45 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Acquired lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:53:45 devstack cinder-volume[75814]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Releasing lock "singleton_lock" {{(pid=75814) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:53:45 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Stop services. {{(pid=75814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 16:53:45 devstack cinder-volume[75814]: DEBUG oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Killing children. {{(pid=75814) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 16:53:45 devstack cinder-volume[75814]: INFO oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Waiting on 1 children to exit Sep 07 16:53:49 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Acquiring lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:53:49 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Acquired lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:53:49 devstack cinder-volume[75996]: DEBUG oslo_concurrency.lockutils [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Releasing lock "singleton_lock" {{(pid=75996) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:53:49 devstack cinder-volume[75996]: WARNING amqp [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:53:49 devstack cinder-volume[75996]: WARNING amqp [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:53:49 devstack cinder-volume[75814]: INFO oslo_service.backend._eventlet.service [None req-09b7fbda-5481-4757-9b70-bf53d9b21d82 None None] Child 75996 exited with status 0 Sep 07 16:53:50 devstack cinder-volume[85988]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:53:50 devstack cinder-volume[85988]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:53:50 devstack cinder-volume[85988]: we strongly recommend against using it for new projects. Sep 07 16:53:50 devstack cinder-volume[85988]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:53:50 devstack cinder-volume[85988]: framework. For more detail see Sep 07 16:53:50 devstack cinder-volume[85988]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:53:50 devstack cinder-volume[85988]: import eventlet # noqa Sep 07 16:53:52 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:53:52 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:53:52 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:53:52 devstack cinder-volume[85988]: INFO dbcounter [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Registered counter for database cinder Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_db.sqlalchemy.engines [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG dbcounter [-] [85988] Writer thread running {{(pid=85988) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:53:53 devstack cinder-volume[85988]: INFO cinder.rpc [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:53:53 devstack cinder-volume[85988]: INFO cinder.rpc [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_db.sqlalchemy.engines [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:53:53 devstack cinder-volume[85988]: INFO cinder.volume.manager [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Determined volume DB was empty at startup. Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG cinder.volume.manager [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85988) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:53:53 devstack cinder-volume[85988]: INFO cinder.volume.manager [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 16:53:53 devstack cinder-volume[85988]: WARNING stevedore.named [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:53:53 devstack cinder-volume[85988]: WARNING castellan.key_manager [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:53:53 devstack cinder-volume[85988]: WARNING cinder.keymgr.conf_key_mgr [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:53:53 devstack cinder-volume[85988]: INFO cinder.volume.manager [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_db.sqlalchemy.engines [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85988) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:53:53 devstack cinder-volume[85988]: INFO oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Starting 1 workers Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Started child 86204 {{(pid=85988) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Full set of CONF: {{(pid=85988) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] ******************************************************************************** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Configuration options gathered from: {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] ================================================================================ {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] allow_availability_zone_fallback = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] allow_compression_on_image_upload = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] allowed_direct_url_schemes = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] api_rate_limit = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] auth_strategy = keystone {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_availability_zone = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_host = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[86204]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_stats_polling_interval = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backup_api_class = cinder.backup.api.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backup_name_template = backup-%s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backup_use_same_host = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backup_use_temp_snapshot = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] chap_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] chap_username = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_internal_tenant_project_id = 195eb4a91ea2444a82139f63ec552c47 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_internal_tenant_user_id = 926dea2953f14266b2de46f70fbebb04 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cluster = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] compression_format = gzip {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] compute_api_class = cinder.compute.nova.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] config_dir = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] config_source = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] control_exchange = openstack {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] debug = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] default_availability_zone = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] default_group_type = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] default_volume_type = QuobyteHD {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] disk_geometry = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_client_cert = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_client_cert_key = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_data_namespace = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_ssl_cert_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_ssl_cert_verify = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] driver_use_ssl = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] enable_new_services = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] enable_unsupported_driver = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] enabled_backends = ['QuobyteHD'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] enforce_multipath_for_image_xfer = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] filter_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_api_insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_api_ssl_compression = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_ca_certificates_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_catalog_info = image:glance:publicURL {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_num_retries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance_request_timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] goodness_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] graceful_shutdown_timeout = 5 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] group_api_class = cinder.group.api.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] host = devstack {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_compress_on_upload = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_conversion_address_space_limit = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_conversion_cpu_limit = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_conversion_disable = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_upload_use_cinder_backend = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_upload_use_internal_tenant = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_volume_cache_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_volume_cache_max_count = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] image_volume_cache_max_size_gb = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] init_host_max_objects_retrieval = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] instance_format = [instance: %(uuid)s] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iscsi_target_flags = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iscsi_write_cache = on {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iser_helper = tgtadm {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iser_ip_address = 192.168.122.80 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iser_port = 3260 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_color = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_config_append = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_dir = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_options = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_rotate_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_rotate_interval_type = days {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] log_rotation_type = none {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] max_age = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] max_logfile_count = 30 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] max_logfile_size_mb = 200 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] max_over_subscription_ratio = 20.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] message_reap_interval = 86400 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] message_ttl = 2592000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] migration_create_volume_timeout_secs = 300 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] monkey_patch = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] monkey_patch_modules = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[86204]: INFO cinder.volume.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 16:53:53 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.remotefs [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86204) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] my_ip = 192.168.122.80 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] no_snapshot_gb_quota = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] num_iser_scan_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] num_shell_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] num_volume_device_scan_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] nvmeof_conn_info_version = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] nvmet_ns_id = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] nvmet_port_id = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_max_limit = 1000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_ext_list = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_listen = 0.0.0.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_listen_port = 8776 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_use_ssl = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] osapi_volume_workers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] per_volume_size_limit = -1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] periodic_fuzzy_delay = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] periodic_interval = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] project_id_regex = [0-9a-f\-]+ {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] public_endpoint = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] publish_errors = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_backup_gigabytes = 1000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_backups = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_gigabytes = 1000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_groups = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_snapshots = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] quota_volumes = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] rate_limit_burst = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] rate_limit_except_level = CRITICAL {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] rate_limit_interval = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] reinit_driver_count = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] replication_device = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] report_discard_supported = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] report_interval = 120 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] reservation_clean_interval = 86400 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] reservation_expire = 86400 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] reserved_image_namespaces = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] reserved_percentage = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] rpc_response_timeout = 120 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] run_external_periodic_tasks = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] scst_target_driver = iscsi {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] scst_target_iqn_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_down_time = 720 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] shell_completion = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] snapshot_name_template = snapshot-%s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] split_loggers = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] state_path = /opt/stack/data/cinder {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] storage_availability_zone = nova {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] storage_protocol = iSCSI {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] syslog_log_facility = LOG_USER {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_helper = lioadm {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_ip_address = 192.168.122.80 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_port = 3260 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_protocol = iscsi {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] target_secondary_ip_addresses = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] trace_flags = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] transfer_api_class = cinder.transfer.api.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] transport_url = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] until_refresh = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_chap_auth = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_default_quota_class = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_journal = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_json = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_multipath_for_image_xfer = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_stderr = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] use_syslog = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] verify_glance_signatures = enabled {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_api_class = cinder.volume.api.API {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_backend_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_clear = zero {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_clear_ionice = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_clear_size = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_copy_bps_limit = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_dd_blocksize = 1M {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_name_template = volume-%s {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_service_inithost_offload = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volume_usage_audit_period = month {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] zoning_mode = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_concurrency.disable_process_locking = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.auth_section = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.auth_type = password {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.auth_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.cache = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.delay_auth_decision = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.http_connect_timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.include_service_catalog = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.interface = public {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcache_username = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.region_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.service_token_roles_required = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.service_type = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.token_cache_time = 300 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.backend = dogpile.cache.null {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.backend_argument = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.backend_expiration_time = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.config_prefix = cache.oslo {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.debug_cache_backend = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.enable_retry_client = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.enable_socket_keepalive = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.expiration_time = 600 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.hashclient_retry_attempts = 2 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_dead_retry = 300 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_pool_maxsize = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_sasl_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.proxies = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.redis_db = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.redis_sentinel_service_name = mymaster {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.redis_server = localhost:6379 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.retry_attempts = 2 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.retry_delay = 0.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.socket_keepalive_count = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.socket_keepalive_idle = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.socket_keepalive_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.socket_timeout = 1.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.tls_allowed_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.tls_cafile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.tls_certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.tls_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.tls_keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cache.username = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] coordination.backend_url = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.asyncio_connection = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.asyncio_slave_connection = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.backend = sqlalchemy {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.connection = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.connection_debug = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86204) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 16:53:53 devstack cinder-volume[86204]: WARNING cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 16:53:53 devstack cinder-volume[86204]: WARNING cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 16:53:53 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Running cmd (subprocess): mount.quobyte {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.connection_parameters = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.connection_recycle_time = 3600 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.connection_trace = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.db_inc_retry_interval = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.db_max_retries = 20 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.db_max_retry_interval = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.db_retry_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.max_overflow = 50 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.max_pool_size = 5 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.max_retries = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.mysql_wsrep_sync_wait = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.pool_timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.retry_interval = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.slave_connection = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.sqlite_synchronous = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.synchronous_reader = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] database.use_db_reconnect = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_tracing.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.connection_string = messaging:// {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.es_doc_type = notification {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.es_scroll_size = 10000 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.es_scroll_time = 2m {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.filter_error_trace = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.hmac_keys = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.sentinel_service_name = mymaster {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.socket_timeout = 0.1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.trace_requests = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler.trace_sqlalchemy = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler_jaeger.process_tags = {} {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler_jaeger.service_name_prefix = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] profiler_otlp.service_name_prefix = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.enforce_new_defaults = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.policy_default_rule = default {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.policy_file = policy.yaml {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_policy.remote_timeout = 60.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.group = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:53 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.helper_command = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] privsep_osbrick.user = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.group = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.helper_command = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] cinder_sys_admin.user = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.auth_section = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.auth_type = password {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.cafile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.collect_timing = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.send_service_user_token = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.split_loggers = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.tls_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] service_user.tls_min_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.auth_section = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.auth_type = password {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.collect_timing = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.region_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.split_loggers = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.tls_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] glance.tls_min_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.backend_availability_zone = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.chap_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.chap_username = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.disk_geometry = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_client_cert = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_client_cert_key = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_data_namespace = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.driver_use_ssl = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.enable_unsupported_driver = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.extra_capabilities = {} {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.filter_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.goodness_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iscsi_target_flags = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iscsi_write_cache = on {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iser_helper = tgtadm {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iser_port = 3260 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack quobyte-client[86209]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 16:53:54 devstack quobyte-client[86209]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] CMD "mount.quobyte" returned: 1 in 0.069s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_host = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_login = admin {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_mount_options = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_private_key = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[86204]: INFO cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 ... Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c -c /etc/quobyte/client-cinder.cfg {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_share_path = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_ssh_port = 22 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.num_shell_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.nvmet_port_id = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_client_cfg = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.quobyte_volume_url = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.replication_device = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.report_discard_supported = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.reserved_percentage = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.scst_target_driver = iscsi {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.scst_target_iqn_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.storage_protocol = iSCSI {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_helper = tgtadm {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_port = 3260 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_protocol = iscsi {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.trace_flags = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.unique_fqdn_network = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.use_chap_auth = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_backend_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c -c /etc/quobyte/client-cinder.cfg Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_clear = zero {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_clear_ionice = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_clear_size = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_reports.file_event_handler = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_reports.log_dir = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.backend_availability_zone = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.backend_host = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.chap_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.chap_username = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.chiscsi_conf = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.disk_geometry = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_client_cert = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_client_cert_key = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_data_namespace = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.driver_use_ssl = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.extra_capabilities = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.filter_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.goodness_function = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iscsi_target_flags = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iscsi_write_cache = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iser_helper = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iser_ip_address = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iser_port = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.iser_target_prefix = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_host = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_login = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_mount_options = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_password = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_private_key = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_share_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_ssh_port = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.num_shell_tries = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nvmet_ns_id = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.nvmet_port_id = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.replication_device = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.report_discard_supported = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.reserved_percentage = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.scst_target_driver = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.storage_protocol = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_helper = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_ip_address = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_port = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_prefix = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_protocol = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.trace_flags = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.unique_fqdn_network = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.use_chap_auth = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_clear = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_clear_ionice = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_clear_size = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] QuobyteHD.volumes_dir = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.ssl_version = {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_notifications.driver = [] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_notifications.retry = -1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] oslo_messaging_notifications.transport_url = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] key_manager.fixed_key = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.barbican_api_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.barbican_endpoint = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.barbican_endpoint_type = public {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.barbican_region_name = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.cafile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.collect_timing = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.number_of_retries = 60 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.retry_delay = 1 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.send_service_user_token = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.split_loggers = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.tls_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.tls_min_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.verify_ssl = True {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican.verify_ssl_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.auth_section = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.auth_type = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.cafile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.certfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.collect_timing = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.insecure = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.keyfile = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.split_loggers = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.timeout = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.tls_ciphers = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] barbican_service_user.tls_min_version = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.approle_role_id = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.approle_secret_id = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.auth_method = approle {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.auth_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.kv_mountpoint = secret {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.kv_path = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.kv_version = 2 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.namespace = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.root_token_id = **** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.ssl_ca_crt_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.timeout = 60.0 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.token_file = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.token_role = None {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.use_ssl = False {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:53:54 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] ******************************************************************************** {{(pid=85988) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:53:54 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.421s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:54 devstack cinder-volume[86204]: INFO cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 succeeded Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.431s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:54 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:53:54 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:54 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.234s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:54 devstack cinder-volume[86204]: INFO cinder.volume.driver [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.volume.driver [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5174179077148, 'free_capacity_gb': 1773.5174179077148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86204) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_db.sqlalchemy.engines [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86204) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG dbcounter [-] [86204] Writer thread running {{(pid=86204) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.db.api [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Building query based on filter {{(pid=86204) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.image.image_utils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86204) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:53:54 devstack cinder-volume[86204]: INFO cinder.keymgr.migration [None req-1d51b3fc-cf55-4e2e-98c0-cb7c06ed7132 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:54 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:54 devstack sudo[86283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:53:54 devstack sudo[86283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:55 devstack sudo[86283]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.218s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG cinder.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Notifying Schedulers of capabilities ... {{(pid=86204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:53:55 devstack cinder-volume[86204]: INFO cinder.volume.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Driver initialization completed successfully. Sep 07 16:53:55 devstack cinder-volume[86204]: INFO cinder.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Initiating service 3 cleanup Sep 07 16:53:55 devstack cinder-volume[86204]: INFO cinder.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Service 3 cleanup completed. Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG cinder.service [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Creating RPC server for service cinder-volume {{(pid=86204) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG cinder.service [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86204) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:53:55 devstack cinder-volume[86204]: INFO cinder.volume.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:55 devstack sudo[86286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:53:55 devstack sudo[86286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:53:55 devstack sudo[86286]: pam_unix(sudo:session): session closed for user root Sep 07 16:53:55 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.236s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:53:55 devstack cinder-volume[86204]: INFO cinder.volume.manager [None req-fae17612-4be3-4763-b3a7-e209f40b62e3 None None] Driver post RPC initialization completed successfully. Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86204) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG cinder.volume.drivers.quobyte [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86204) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86204) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:53:59 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:53:59 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:53:59 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:00 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:00 devstack cinder-volume[86204]: DEBUG oslo_concurrency.processutils [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.236s {{(pid=86204) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:00 devstack cinder-volume[86204]: DEBUG cinder.manager [None req-e10d988f-a481-444e-ad10-e3aa9818f29e None None] Notifying Schedulers of capabilities ... {{(pid=86204) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:00 devstack cinder-volume[85988]: INFO oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Caught SIGTERM, stopping children Sep 07 16:54:00 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Acquiring lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:54:00 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Acquired lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:54:00 devstack cinder-volume[85988]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Releasing lock "singleton_lock" {{(pid=85988) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:54:00 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Stop services. {{(pid=85988) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 16:54:00 devstack cinder-volume[85988]: DEBUG oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Killing children. {{(pid=85988) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 16:54:00 devstack cinder-volume[85988]: INFO oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Waiting on 1 children to exit Sep 07 16:54:03 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Acquiring lock "singleton_lock" {{(pid=86204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:54:03 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Acquired lock "singleton_lock" {{(pid=86204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:54:03 devstack cinder-volume[86204]: DEBUG oslo_concurrency.lockutils [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Releasing lock "singleton_lock" {{(pid=86204) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:54:03 devstack cinder-volume[86204]: WARNING amqp [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:54:03 devstack cinder-volume[86204]: WARNING amqp [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 16:54:03 devstack cinder-volume[85988]: INFO oslo_service.backend._eventlet.service [None req-1389a094-1b77-4a8c-9c18-266143e253ba None None] Child 86204 exited with status 0 Sep 07 16:54:04 devstack cinder-volume[86484]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 16:54:04 devstack cinder-volume[86484]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:54:04 devstack cinder-volume[86484]: we strongly recommend against using it for new projects. Sep 07 16:54:04 devstack cinder-volume[86484]: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:54:04 devstack cinder-volume[86484]: framework. For more detail see Sep 07 16:54:04 devstack cinder-volume[86484]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:54:04 devstack cinder-volume[86484]: import eventlet # noqa Sep 07 16:54:07 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 16:54:07 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 16:54:07 devstack cinder-volume[86484]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86484) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 16:54:07 devstack cinder-volume[86484]: INFO dbcounter [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Registered counter for database cinder Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG dbcounter [-] [86484] Writer thread running {{(pid=86484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:54:08 devstack cinder-volume[86484]: INFO cinder.rpc [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 16:54:08 devstack cinder-volume[86484]: INFO cinder.rpc [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:54:08 devstack cinder-volume[86484]: INFO cinder.volume.manager [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Determined volume DB was empty at startup. Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG cinder.volume.manager [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86484) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 16:54:08 devstack cinder-volume[86484]: WARNING stevedore.named [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 16:54:08 devstack cinder-volume[86484]: WARNING castellan.key_manager [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:54:08 devstack cinder-volume[86484]: WARNING cinder.keymgr.conf_key_mgr [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 16:54:08 devstack cinder-volume[86484]: INFO cinder.volume.manager [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_db.sqlalchemy.engines [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86484) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:54:08 devstack cinder-volume[86484]: INFO oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Starting 1 workers Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Started child 86783 {{(pid=86484) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Full set of CONF: {{(pid=86484) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] ******************************************************************************** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] Configuration options gathered from: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] ================================================================================ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] allow_availability_zone_fallback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] allow_compression_on_image_upload = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] allowed_direct_url_schemes = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86783]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] api_rate_limit = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] auth_strategy = keystone {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_stats_polling_interval = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backup_api_class = cinder.backup.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backup_name_template = backup-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backup_use_same_host = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backup_use_temp_snapshot = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] chap_username = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_internal_tenant_project_id = 195eb4a91ea2444a82139f63ec552c47 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_internal_tenant_user_id = 926dea2953f14266b2de46f70fbebb04 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cluster = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] compression_format = gzip {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] compute_api_class = cinder.compute.nova.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] config_dir = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] config_source = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] control_exchange = openstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] debug = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] default_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] default_group_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] default_volume_type = QuobyteHD {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_ssl_cert_verify = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] driver_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] enable_new_services = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] enable_unsupported_driver = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] enabled_backends = ['QuobyteHD'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] enforce_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_api_insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_api_servers = ['http://192.168.122.80/image'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_api_ssl_compression = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_ca_certificates_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_catalog_info = image:glance:publicURL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_num_retries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance_request_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] graceful_shutdown_timeout = 5 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] group_api_class = cinder.group.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] host = devstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_compress_on_upload = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_conversion_address_space_limit = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_conversion_cpu_limit = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_conversion_disable = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_upload_use_cinder_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_upload_use_internal_tenant = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_volume_cache_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_volume_cache_max_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] image_volume_cache_max_size_gb = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] init_host_max_objects_retrieval = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] instance_format = [instance: %(uuid)s] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iscsi_target_flags = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iscsi_write_cache = on {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iser_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iser_ip_address = 192.168.122.80 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iser_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_color = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_config_append = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_options = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_rotate_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_rotate_interval_type = days {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] log_rotation_type = none {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] max_age = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] max_logfile_count = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] max_logfile_size_mb = 200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] max_over_subscription_ratio = 20.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] message_reap_interval = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] message_ttl = 2592000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] migration_create_volume_timeout_secs = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] monkey_patch = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] monkey_patch_modules = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] my_ip = 192.168.122.80 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] no_snapshot_gb_quota = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] num_iser_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] num_shell_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] num_volume_device_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] nvmeof_conn_info_version = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] nvmet_ns_id = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] nvmet_port_id = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_max_limit = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_ext_list = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_listen_port = 8776 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] osapi_volume_workers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] per_volume_size_limit = -1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] periodic_fuzzy_delay = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] periodic_interval = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] public_endpoint = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] publish_errors = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_backup_gigabytes = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86783) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_backups = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_gigabytes = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_groups = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_snapshots = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] quota_volumes = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] rate_limit_burst = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] rate_limit_except_level = CRITICAL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] rate_limit_interval = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] reinit_driver_count = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] report_discard_supported = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] report_interval = 120 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] reservation_clean_interval = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] reservation_expire = 86400 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] reserved_image_namespaces = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] reserved_percentage = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] rpc_response_timeout = 120 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] run_external_periodic_tasks = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] scst_target_driver = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_down_time = 720 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] shell_completion = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] snapshot_name_template = snapshot-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] state_path = /opt/stack/data/cinder {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] storage_availability_zone = nova {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] storage_protocol = iSCSI {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] syslog_log_facility = LOG_USER {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_helper = lioadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_ip_address = 192.168.122.80 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_protocol = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] target_secondary_ip_addresses = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] transport_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] until_refresh = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_chap_auth = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_default_quota_class = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_journal = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_json = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_stderr = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] use_syslog = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] verify_glance_signatures = enabled {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_api_class = cinder.volume.api.API {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_clear = zero {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_clear_size = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_copy_bps_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_dd_blocksize = 1M {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_name_template = volume-%s {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_service_inithost_offload = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volume_usage_audit_period = month {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] zoning_mode = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_concurrency.disable_process_locking = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.auth_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.include_service_catalog = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.interface = public {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcache_username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.service_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.80/identity {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.backend = dogpile.cache.null {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.backend_argument = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.backend_expiration_time = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.config_prefix = cache.oslo {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.debug_cache_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.enable_retry_client = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.enable_socket_keepalive = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.expiration_time = 600 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.hashclient_retry_attempts = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_dead_retry = 300 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_pool_maxsize = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_sasl_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.proxies = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.redis_db = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.redis_server = localhost:6379 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.retry_attempts = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.retry_delay = 0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.socket_keepalive_count = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.socket_keepalive_idle = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.socket_keepalive_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.socket_timeout = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.tls_allowed_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.tls_cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.tls_certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.tls_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.tls_keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cache.username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] coordination.backend_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.asyncio_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.asyncio_slave_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.backend = sqlalchemy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.connection_debug = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.connection_parameters = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.connection_recycle_time = 3600 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.connection_trace = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.db_inc_retry_interval = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.db_max_retries = 20 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.db_max_retry_interval = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.db_retry_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.max_overflow = 50 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.max_pool_size = 5 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.max_retries = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.mysql_wsrep_sync_wait = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.pool_timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.retry_interval = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.slave_connection = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.sqlite_synchronous = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.synchronous_reader = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] database.use_db_reconnect = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_tracing.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.connection_string = messaging:// {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.es_doc_type = notification {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.es_scroll_size = 10000 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.es_scroll_time = 2m {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.filter_error_trace = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.hmac_keys = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.sentinel_service_name = mymaster {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.socket_timeout = 0.1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.trace_requests = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler.trace_sqlalchemy = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler_jaeger.process_tags = {} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler_jaeger.service_name_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] profiler_otlp.service_name_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.enforce_new_defaults = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.policy_default_rule = default {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.policy_file = policy.yaml {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86783) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.group = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.helper_command = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Running cmd (subprocess): mount.quobyte {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] privsep_osbrick.user = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.group = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.helper_command = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] cinder_sys_admin.user = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.send_service_user_token = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] service_user.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.auth_type = password {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] glance.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.chap_username = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.driver_use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.extra_capabilities = {} {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iscsi_target_flags = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iscsi_write_cache = on {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iser_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iser_ip_address = 192.168.122.80 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iser_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_host = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_login = admin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_mount_options = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_private_key = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_share_path = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.num_shell_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.quobyte_volume_url = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.report_discard_supported = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.reserved_percentage = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_helper = tgtadm {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_ip_address = 192.168.122.80 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_port = 3260 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_protocol = iscsi {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.unique_fqdn_network = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.use_chap_auth = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_backend_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_clear = zero {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_clear_size = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_reports.file_event_handler = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_reports.log_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.backend_availability_zone = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.backend_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.chap_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.chap_username = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.chiscsi_conf = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.disk_geometry = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_client_cert = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_data_namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.driver_use_ssl = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.extra_capabilities = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.filter_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.goodness_function = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iser_helper = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iser_ip_address = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iser_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.iser_target_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_host = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_login = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_mount_options = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_password = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_private_key = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_share_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_ssh_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.num_shell_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.nvmet_port_id = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack quobyte-client[86786]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.replication_device = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.report_discard_supported = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.reserved_percentage = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.scst_target_driver = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack quobyte-client[86786]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.storage_protocol = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_helper = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_ip_address = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_port = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_prefix = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_protocol = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.trace_flags = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.use_chap_auth = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_clear = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_clear_size = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] QuobyteHD.volumes_dir = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_notifications.driver = [] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_notifications.retry = -1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] key_manager.fixed_key = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.barbican_api_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.barbican_endpoint = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.barbican_endpoint_type = public {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.barbican_region_name = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.number_of_retries = 60 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.retry_delay = 1 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.send_service_user_token = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.verify_ssl = True {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican.verify_ssl_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.auth_section = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.auth_type = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.cafile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.certfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.collect_timing = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.insecure = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.keyfile = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.split_loggers = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.timeout = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.tls_ciphers = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] barbican_service_user.tls_min_version = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.approle_role_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.approle_secret_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.auth_method = approle {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.auth_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.kv_mountpoint = secret {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.kv_path = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.kv_version = 2 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.namespace = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.root_token_id = **** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.ssl_ca_crt_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.timeout = 60.0 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.token_file = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.token_role = None {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.use_ssl = False {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 16:54:08 devstack cinder-volume[86484]: DEBUG oslo_service.backend._eventlet.service [None req-c3ac5a0b-17e3-4503-997b-66058d1c1e26 None None] ******************************************************************************** {{(pid=86484) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 16:54:08 devstack sudo[86787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:54:08 devstack sudo[86787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:08 devstack sudo[86787]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.volume.driver [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Driver hasn't implemented _init_vendor_properties() Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.driver [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5174179077148, 'free_capacity_gb': 1773.5174179077148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_db.sqlalchemy.engines [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writer thread running {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.db.api [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Building query based on filter {{(pid=86783) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86783) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.keymgr.migration [None req-c06f9abe-c41c-473d-885c-4c0e795d1ec1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 16:54:09 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:54:09 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:09 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.230s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Driver initialization completed successfully. Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Initiating service 3 cleanup Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Service 3 cleanup completed. Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.service [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Creating RPC server for service cinder-volume {{(pid=86783) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.service [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86783) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:54:09 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:54:09 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:54:09 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Sep 07 16:54:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.236s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:54:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2701439c-c6d3-4d6e-862b-e43e7082a2dd None None] Driver post RPC initialization completed successfully. Sep 07 16:54:18 devstack cinder-volume[86484]: DEBUG dbcounter [-] [86484] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86484) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:54:19 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:54:19 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:09 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:55:09 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:10 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.754s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 6 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:55:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:55:13 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Flow 'volume_create_manager' (19b3a409-2bc7-45d6-8361-a85b1f894cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8081bced-19ba-4fb8-a177-51309cd7fae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8081bced-19ba-4fb8-a177-51309cd7fae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-557145022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f470869-3e9a-41fa-81a4-9c4e13aea78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110478da030346dea23f435de7a0cab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:14Z,use_quota=True,user_id='b1772f2d6d1545218bbfc4e2185fcca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764ba5f-d0cd-465c-a0f0-a3af43b9ab39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8764ba5f-d0cd-465c-a0f0-a3af43b9ab39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbfe896-8710-402f-ba21-aeb0beffc876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfbfe896-8710-402f-ba21-aeb0beffc876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f470869-3e9a-41fa-81a4-9c4e13aea78f', 'volume_name': 'volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af903c6d-c6fd-409d-9ac4-5564d3e646e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af903c6d-c6fd-409d-9ac4-5564d3e646e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a888d11-0ed9-47ef-b037-25d664fe32cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Volume 9f470869-3e9a-41fa-81a4-9c4e13aea78f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f', 'volume_size': 1} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-557145022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f470869-3e9a-41fa-81a4-9c4e13aea78f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110478da030346dea23f435de7a0cab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:14Z,use_quota=True,user_id='b1772f2d6d1545218bbfc4e2185fcca1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Creating volume 9f470869-3e9a-41fa-81a4-9c4e13aea78f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:55:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:14 devstack sudo[88090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f 1073741824 Sep 07 16:55:14 devstack sudo[88090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:16 devstack sudo[88090]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f 1073741824" returned: 0 in 1.696s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:16 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f Sep 07 16:55:16 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:17 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f" returned: 0 in 0.875s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] <== create_volume: return (2713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.717s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a888d11-0ed9-47ef-b037-25d664fe32cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8081f90-0400-4fca-8f11-1d3bdfc3ac26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Volume volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f (9f470869-3e9a-41fa-81a4-9c4e13aea78f): created successfully Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8081f90-0400-4fca-8f11-1d3bdfc3ac26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Flow 'volume_create_manager' (19b3a409-2bc7-45d6-8361-a85b1f894cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5a9e5f0a-1035-433b-8347-0d765c433838 tempest-DeleteServersTestJSON-1520871118 None] Created volume successfully. Sep 07 16:55:25 devstack cinder-volume[86783]: WARNING py.warnings [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 07 16:55:25 devstack cinder-volume[86783]: .first() Sep 07 16:55:25 devstack cinder-volume[86783]: Sep 07 16:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1681daa4-2eee-4e12-ab1f-7aabac182619', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:55:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-4b097dc1-cd90-4039-bab8-b753f9bb6bcc req-e568495c-5c55-4302-ad5e-4f951e43bf37 tempest-DeleteServersTestJSON-1520871118 None] attachment_update completed successfully. Sep 07 16:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Flow 'volume_create_manager' (3f2f0096-e454-49d3-a9d3-fb97d29ad82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e797eaf9-31dc-400a-a66a-1216a38a5f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e797eaf9-31dc-400a-a66a-1216a38a5f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1100606352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94db9db7-47fd-4ec5-92da-28a2474d98ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10191976b419421a9ff9a3c565527b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:28Z,use_quota=True,user_id='1792432d0319494e9bfdb75db3c833a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ac1010-b100-4912-a042-83dddd6b2286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ac1010-b100-4912-a042-83dddd6b2286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae485e9-4388-46c7-b6db-c54919162af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ae485e9-4388-46c7-b6db-c54919162af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94db9db7-47fd-4ec5-92da-28a2474d98ab', 'volume_name': 'volume-94db9db7-47fd-4ec5-92da-28a2474d98ab', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e0ddbb-2bae-4a03-8519-04ff0cd40be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e0ddbb-2bae-4a03-8519-04ff0cd40be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0d860-1df6-4ba4-b299-22658f2265e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Volume 94db9db7-47fd-4ec5-92da-28a2474d98ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94db9db7-47fd-4ec5-92da-28a2474d98ab', 'volume_size': 1} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:55:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1100606352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94db9db7-47fd-4ec5-92da-28a2474d98ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='10191976b419421a9ff9a3c565527b09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:55:28Z,use_quota=True,user_id='1792432d0319494e9bfdb75db3c833a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Creating volume 94db9db7-47fd-4ec5-92da-28a2474d98ab {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:55:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:28 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab 1073741824 Sep 07 16:55:28 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:28 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab 1073741824" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:28 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab Sep 07 16:55:28 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:29 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad0d860-1df6-4ba4-b299-22658f2265e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94db9db7-47fd-4ec5-92da-28a2474d98ab', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7bb93-3745-49ac-b8cc-08b9bac092ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:55:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Volume volume-94db9db7-47fd-4ec5-92da-28a2474d98ab (94db9db7-47fd-4ec5-92da-28a2474d98ab): created successfully Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64d7bb93-3745-49ac-b8cc-08b9bac092ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:55:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Flow 'volume_create_manager' (3f2f0096-e454-49d3-a9d3-fb97d29ad82c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:55:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02053316-caa1-4147-a274-70126507fab5 tempest-ServerRescueNegativeTestJSON-1150593618 None] Created volume successfully. Sep 07 16:55:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-4ff8cefd-3ff7-47b0-ae3c-286ecf0c787c req-6811bc52-3341-42bd-b074-6e40c9e95f5a tempest-DeleteServersTestJSON-1520871118 None] Terminate volume connection completed successfully. Sep 07 16:55:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-4ff8cefd-3ff7-47b0-ae3c-286ecf0c787c req-6811bc52-3341-42bd-b074-6e40c9e95f5a tempest-DeleteServersTestJSON-1520871118 None] Deleting attachment 1681daa4-2eee-4e12-ab1f-7aabac182619. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:55:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "cinder-9f470869-3e9a-41fa-81a4-9c4e13aea78f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "cinder-9f470869-3e9a-41fa-81a4-9c4e13aea78f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "cinder-quobyte-9f470869-3e9a-41fa-81a4-9c4e13aea78f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "cinder-quobyte-9f470869-3e9a-41fa-81a4-9c4e13aea78f" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:34 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp2acvs7d6/privsep.sock'] Sep 07 16:55:34 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp2acvs7d6/privsep.sock Sep 07 16:55:34 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 16:55:35 devstack cinder-volume[86783]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 16:55:35 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:35 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Spawned new privsep daemon via rootwrap Sep 07 16:55:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Accepted privsep connection to /tmp/tmp2acvs7d6/privsep.sock {{(pid=86783) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 16:55:35 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 16:55:35 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 16:55:35 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 16:55:35 devstack cinder-volume[86783]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 89052 Sep 07 16:55:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb39724-ab31-4e6e-bfca-0de156dbb091]: (2,) {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674d7b8-d043-49cd-bdca-aa24687e6fd6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:36 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f Sep 07 16:55:36 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:36 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f" returned: 0 in 0.922s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:37 devstack sudo[89062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f Sep 07 16:55:37 devstack sudo[89062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:37 devstack sudo[89062]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9f470869-3e9a-41fa-81a4-9c4e13aea78f" returned: 0 in 0.558s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "cinder-quobyte-9f470869-3e9a-41fa-81a4-9c4e13aea78f" released by "delete_volume" :: held 3.385s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:37 devstack cinder-volume[86783]: WARNING cinder.quota [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:55:37 devstack cinder-volume[86783]: WARNING cinder.quota [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Created reservations ['a4dab7d4-e918-46ee-9a57-32a02a9ddec0', '4f524350-7ae5-467d-8099-d84966ada018', '58f79797-a8f8-4936-9704-5fcd1baf01a1', '8b0cb00c-de28-4ac4-88fa-6e60970959c3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:37 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:55:37 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:38 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Deleted volume successfully. Sep 07 16:55:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fe66c294-ccb7-48c0-9f16-248bf614d617 tempest-DeleteServersTestJSON-1520871118 None] Lock "cinder-9f470869-3e9a-41fa-81a4-9c4e13aea78f-delete_volume" released by "delete_volume" :: held 4.316s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Acquiring lock "cinder-94db9db7-47fd-4ec5-92da-28a2474d98ab-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "cinder-94db9db7-47fd-4ec5-92da-28a2474d98ab-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Acquiring lock "cinder-quobyte-94db9db7-47fd-4ec5-92da-28a2474d98ab" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "cinder-quobyte-94db9db7-47fd-4ec5-92da-28a2474d98ab" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3b112d-53e9-4d46-8710-20410c9790e6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:55:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:43 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab Sep 07 16:55:43 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:44 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab" returned: 0 in 0.614s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:44 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab Sep 07 16:55:44 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:44 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-94db9db7-47fd-4ec5-92da-28a2474d98ab" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "cinder-quobyte-94db9db7-47fd-4ec5-92da-28a2474d98ab" released by "delete_volume" :: held 1.055s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Created reservations ['0bee38bd-77ba-44b5-83d1-e8e308bd5504', '9036dfc6-4230-40bb-8729-6a5cd9794a77', '73f06b80-f133-4590-aed9-5ccdb46a0cf2', '2c013a63-bc2b-4cff-846c-b5b6630ce3a6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:55:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:55:44 devstack sudo[89162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:55:44 devstack sudo[89162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:55:45 devstack sudo[89162]: pam_unix(sudo:session): session closed for user root Sep 07 16:55:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:55:45 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:55:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Deleted volume successfully. Sep 07 16:55:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fcf86ba-adef-482e-a1c2-9f362e82ba35 tempest-ServerRescueNegativeTestJSON-1150593618 None] Lock "cinder-94db9db7-47fd-4ec5-92da-28a2474d98ab-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:55:54 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=22,cinder:SELECT=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:55:55 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=22,cinder:UPDATE=25,cinder:DELETE=2,cinder:INSERT=4 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Flow 'volume_create_manager' (eca4371f-e9d6-4e2a-b319-f47d368f24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1993ca94-20df-4c49-8e7e-147b6d74d0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1993ca94-20df-4c49-8e7e-147b6d74d0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1677275499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fd08ac-0635-495a-a29c-35f3fe81c6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb26edd75f48e9a7078f4d54fc9403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:05Z,use_quota=True,user_id='ec9cd659319142c98fffff0993e7d8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c18a29a-0a20-4be7-846b-ea64ea3fda93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c18a29a-0a20-4be7-846b-ea64ea3fda93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82f283f-fd3f-47d9-979d-103e0469f858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e82f283f-fd3f-47d9-979d-103e0469f858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'volume_name': 'volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0edb55f-ad4c-4c02-9600-6bc02fabc27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0edb55f-ad4c-4c02-9600-6bc02fabc27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423544bf-5a68-4222-b3e9-37aeaa721fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Volume 13fd08ac-0635-495a-a29c-35f3fe81c6f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'volume_size': 1} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1677275499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13fd08ac-0635-495a-a29c-35f3fe81c6f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb26edd75f48e9a7078f4d54fc9403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:05Z,use_quota=True,user_id='ec9cd659319142c98fffff0993e7d8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Creating volume 13fd08ac-0635-495a-a29c-35f3fe81c6f5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:05 devstack sudo[89241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 1073741824 Sep 07 16:56:05 devstack sudo[89241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:05 devstack sudo[89241]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 1073741824" returned: 0 in 0.621s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:05 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 Sep 07 16:56:05 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:06 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (423544bf-5a68-4222-b3e9-37aeaa721fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f8360b-e347-4c90-8c12-6208a165bf68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Volume volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 (13fd08ac-0635-495a-a29c-35f3fe81c6f5): created successfully Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40f8360b-e347-4c90-8c12-6208a165bf68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Flow 'volume_create_manager' (eca4371f-e9d6-4e2a-b319-f47d368f24a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4686e671-91da-440e-8799-e860c073351a tempest-ServerActionsTestOtherA-345339788 None] Created volume successfully. Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Flow 'volume_create_manager' (36792008-f00b-4ca5-b79c-eda3c74265b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367d0444-616c-457c-bd29-09e7bc52843b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (367d0444-616c-457c-bd29-09e7bc52843b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-566715117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a6be7-d885-4281-9bcd-bfb770a745dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0a8f91eb4ec4efd87a0f2c8ddd2b1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:10Z,use_quota=True,user_id='c56a912b16ba4bbaba6aea87c072a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e46e7a-2efc-442a-8203-bcb42935af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91e46e7a-2efc-442a-8203-bcb42935af03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a26ac-3e12-44f7-b927-70fdc1f4ccf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204a26ac-3e12-44f7-b927-70fdc1f4ccf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '918a6be7-d885-4281-9bcd-bfb770a745dc', 'volume_name': 'volume-918a6be7-d885-4281-9bcd-bfb770a745dc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c11dfc3-5081-4ef2-ac3f-d81f40626cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c11dfc3-5081-4ef2-ac3f-d81f40626cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c33f5c-401c-4062-87d0-9ffa5c99c88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Volume 918a6be7-d885-4281-9bcd-bfb770a745dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-918a6be7-d885-4281-9bcd-bfb770a745dc', 'volume_size': 1} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-566715117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=918a6be7-d885-4281-9bcd-bfb770a745dc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f0a8f91eb4ec4efd87a0f2c8ddd2b1a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:10Z,use_quota=True,user_id='c56a912b16ba4bbaba6aea87c072a934',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Creating volume 918a6be7-d885-4281-9bcd-bfb770a745dc {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:10 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:56:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:10 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc 1073741824 Sep 07 16:56:10 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:11 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc 1073741824" returned: 0 in 0.573s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:11 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc Sep 07 16:56:11 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:11 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c33f5c-401c-4062-87d0-9ffa5c99c88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-918a6be7-d885-4281-9bcd-bfb770a745dc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798e6c14-5b1d-4bf2-9af6-c13f1f330974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Volume volume-918a6be7-d885-4281-9bcd-bfb770a745dc (918a6be7-d885-4281-9bcd-bfb770a745dc): created successfully Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798e6c14-5b1d-4bf2-9af6-c13f1f330974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Flow 'volume_create_manager' (36792008-f00b-4ca5-b79c-eda3c74265b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-b7f316dc-a79e-4e6b-90c7-2e424031f15d req-a9f60311-8fe0-45ca-be4b-7155f61d94db tempest-VolumesGetTestJSON-977689403 None] Created volume successfully. Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Acquiring lock "cinder-918a6be7-d885-4281-9bcd-bfb770a745dc-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "cinder-918a6be7-d885-4281-9bcd-bfb770a745dc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Acquiring lock "cinder-quobyte-918a6be7-d885-4281-9bcd-bfb770a745dc" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "cinder-quobyte-918a6be7-d885-4281-9bcd-bfb770a745dc" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff28a0f4-1c6b-4836-9521-dcd8f38a595d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:12 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc Sep 07 16:56:12 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:13 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:13 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc Sep 07 16:56:13 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:13 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-918a6be7-d885-4281-9bcd-bfb770a745dc" returned: 0 in 0.505s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "cinder-quobyte-918a6be7-d885-4281-9bcd-bfb770a745dc" released by "delete_volume" :: held 1.050s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG cinder.quota [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Created reservations ['1fea9222-4d23-4081-83e6-503501a40d71', '44783c27-96d5-48e4-a969-a451e856f2bb', '99a3be45-479d-4224-afa1-d67c1e9abcc0', 'cfd39e9a-89a1-427d-a6f0-15131babb6d6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:14 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:56:14 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:14 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.633s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:14 devstack cinder-volume[86783]: DEBUG cinder.manager [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Deleted volume successfully. Sep 07 16:56:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-32aabb12-e5db-462e-bba8-a4013de715a2 req-21670904-0f76-4c12-bcf8-4bc7ecee1629 tempest-VolumesGetTestJSON-977689403 None] Lock "cinder-918a6be7-d885-4281-9bcd-bfb770a745dc-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:24 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=14,cinder:SELECT=9,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:56:25 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=10,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Flow 'volume_create_manager' (d7ba641b-08fb-4b51-bf8f-4de50e162848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b110d26-883c-4c70-9f2f-95a604d1dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b110d26-883c-4c70-9f2f-95a604d1dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1633235346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adfb099-c8bb-4790-a300-71cbc21122b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f98c82863945468b961fce1236aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:46Z,use_quota=True,user_id='ee5001306aba449a82ca641787fb388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ebdae7-ecf1-4ee8-8324-7fefb883c02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30ebdae7-ecf1-4ee8-8324-7fefb883c02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e206d0-1786-4e9c-b4e3-87b386107aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e206d0-1786-4e9c-b4e3-87b386107aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7adfb099-c8bb-4790-a300-71cbc21122b4', 'volume_name': 'volume-7adfb099-c8bb-4790-a300-71cbc21122b4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f50777-732b-4ed5-a950-79337177b867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f50777-732b-4ed5-a950-79337177b867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe8990d-e516-430c-a2aa-e7b93d5864dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Volume 7adfb099-c8bb-4790-a300-71cbc21122b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7adfb099-c8bb-4790-a300-71cbc21122b4', 'volume_size': 1} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1633235346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7adfb099-c8bb-4790-a300-71cbc21122b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f98c82863945468b961fce1236aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:46Z,use_quota=True,user_id='ee5001306aba449a82ca641787fb388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Creating volume 7adfb099-c8bb-4790-a300-71cbc21122b4 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:56:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:46 devstack sudo[89714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 1073741824 Sep 07 16:56:46 devstack sudo[89714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:47 devstack sudo[89714]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 1073741824" returned: 0 in 1.043s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:48 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 Sep 07 16:56:48 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:48 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4" returned: 0 in 0.432s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fe8990d-e516-430c-a2aa-e7b93d5864dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7adfb099-c8bb-4790-a300-71cbc21122b4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c10989-1fe0-4522-afc4-9df029c192f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Volume volume-7adfb099-c8bb-4790-a300-71cbc21122b4 (7adfb099-c8bb-4790-a300-71cbc21122b4): created successfully Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5c10989-1fe0-4522-afc4-9df029c192f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Flow 'volume_create_manager' (d7ba641b-08fb-4b51-bf8f-4de50e162848) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6b0ea11-a3f7-4590-8629-63365430a66a tempest-ServersNegativeTestJSON-1604668905 None] Created volume successfully. Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Flow 'volume_create_manager' (13f0ddc5-aa4e-423d-9021-649a4eb60887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be01697-a942-4cb9-9f93-0e9e0ca5d678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be01697-a942-4cb9-9f93-0e9e0ca5d678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1023090659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ac0ef3-e3e3-4f12-aaab-babe8d8324c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ad871eada34b12a444a1a6058d33e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:50Z,use_quota=True,user_id='594d8890f7594d2d9577872a32608837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d400a230-64e0-4493-b9a4-bf7f7b154601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d400a230-64e0-4493-b9a4-bf7f7b154601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b425e58-d838-4a22-bfeb-0cefb948bfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b425e58-d838-4a22-bfeb-0cefb948bfef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87ac0ef3-e3e3-4f12-aaab-babe8d8324c9', 'volume_name': 'volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57716de-800f-473b-9bfe-614996c00777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c57716de-800f-473b-9bfe-614996c00777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c477de-c969-4a30-adaf-5a9c4590046d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Volume 87ac0ef3-e3e3-4f12-aaab-babe8d8324c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9', 'volume_size': 1} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1023090659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87ac0ef3-e3e3-4f12-aaab-babe8d8324c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ad871eada34b12a444a1a6058d33e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:50Z,use_quota=True,user_id='594d8890f7594d2d9577872a32608837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Creating volume 87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:50 devstack sudo[89745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 1073741824 Sep 07 16:56:50 devstack sudo[89745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:50 devstack sudo[89745]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 1073741824" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:51 devstack sudo[89751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 Sep 07 16:56:51 devstack sudo[89751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:51 devstack sudo[89751]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" returned: 0 in 0.552s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70c477de-c969-4a30-adaf-5a9c4590046d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35114037-ffb8-4460-a7b7-d530d69a1636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Volume volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 (87ac0ef3-e3e3-4f12-aaab-babe8d8324c9): created successfully Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35114037-ffb8-4460-a7b7-d530d69a1636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Flow 'volume_create_manager' (13f0ddc5-aa4e-423d-9021-649a4eb60887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4b0af551-5238-4998-955c-4efd35d10e64 tempest-VolumesAdminNegativeTest-2080539210 None] Created volume successfully. Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Flow 'volume_create_manager' (abf159a8-bfb0-4f21-98a7-a7d63f2a7511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2901e085-5fdd-4925-8e86-0804408a034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2901e085-5fdd-4925-8e86-0804408a034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1408542129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca49fc1b-1108-4218-a983-7c6285cc4678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f98c82863945468b961fce1236aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:52Z,use_quota=True,user_id='ee5001306aba449a82ca641787fb388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67ce3e-9b02-49d0-84aa-773c54741c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d67ce3e-9b02-49d0-84aa-773c54741c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b9c74b-fbc1-4433-a969-9239618c1d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6b9c74b-fbc1-4433-a969-9239618c1d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca49fc1b-1108-4218-a983-7c6285cc4678', 'volume_name': 'volume-ca49fc1b-1108-4218-a983-7c6285cc4678', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080309c1-dce4-4980-9403-ff62a5edcaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (080309c1-dce4-4980-9403-ff62a5edcaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12d6ae8-9ee8-4a74-ac62-39b491a6f085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Volume ca49fc1b-1108-4218-a983-7c6285cc4678: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca49fc1b-1108-4218-a983-7c6285cc4678', 'volume_size': 1} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1408542129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca49fc1b-1108-4218-a983-7c6285cc4678,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42f98c82863945468b961fce1236aa81',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:56:52Z,use_quota=True,user_id='ee5001306aba449a82ca641787fb388b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Creating volume ca49fc1b-1108-4218-a983-7c6285cc4678 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:56:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:56:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:51 devstack sudo[89756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 1073741824 Sep 07 16:56:51 devstack sudo[89756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:52 devstack sudo[89756]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 1073741824" returned: 0 in 0.649s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:52 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 Sep 07 16:56:52 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:53 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f12d6ae8-9ee8-4a74-ac62-39b491a6f085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca49fc1b-1108-4218-a983-7c6285cc4678', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbb80b-9c22-4b5c-8462-79226cdd45c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:56:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Volume volume-ca49fc1b-1108-4218-a983-7c6285cc4678 (ca49fc1b-1108-4218-a983-7c6285cc4678): created successfully Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32bbb80b-9c22-4b5c-8462-79226cdd45c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Flow 'volume_create_manager' (abf159a8-bfb0-4f21-98a7-a7d63f2a7511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Acquiring lock "cinder-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cb6afba9-6a27-4f3f-9915-7b3113bc67e9 tempest-ServersNegativeTestJSON-1604668905 None] Created volume successfully. Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "cinder-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Acquiring lock "cinder-quobyte-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "cinder-quobyte-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54ecc0d-5a0e-44c2-9bf3-b577772acb1d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:53 devstack sudo[89772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 Sep 07 16:56:53 devstack sudo[89772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38372fb0-0437-47f8-88d0-c2e6521a3cd0 req-a7ed055d-e133-4ea8-b5d7-122c9dff37f8 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38372fb0-0437-47f8-88d0-c2e6521a3cd0 req-a7ed055d-e133-4ea8-b5d7-122c9dff37f8 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38372fb0-0437-47f8-88d0-c2e6521a3cd0 req-a7ed055d-e133-4ea8-b5d7-122c9dff37f8 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-38372fb0-0437-47f8-88d0-c2e6521a3cd0 req-a7ed055d-e133-4ea8-b5d7-122c9dff37f8 tempest-ServerActionsTestOtherA-345339788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '479a6957-55c7-40b5-ac05-a8d8c671352d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:56:53 devstack sudo[89772]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" returned: 0 in 0.595s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:53 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9 Sep 07 16:56:53 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-38372fb0-0437-47f8-88d0-c2e6521a3cd0 req-a7ed055d-e133-4ea8-b5d7-122c9dff37f8 tempest-ServerActionsTestOtherA-345339788 None] attachment_update completed successfully. Sep 07 16:56:54 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "cinder-quobyte-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9" released by "delete_volume" :: held 1.070s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Created reservations ['73bfe96f-47c9-4e12-9695-e986823357b0', '699e0c30-cd4e-49cf-b4d3-0794277935d0', '7f18ddd9-fb08-4bfb-b2fd-c9e4cd8aa7d7', '0f00d565-d90a-4772-9305-169ec9cbef16'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "cinder-ca49fc1b-1108-4218-a983-7c6285cc4678-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-ca49fc1b-1108-4218-a983-7c6285cc4678-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:54 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:56:54 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "cinder-quobyte-ca49fc1b-1108-4218-a983-7c6285cc4678" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-quobyte-ca49fc1b-1108-4218-a983-7c6285cc4678" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7efe1b-22cb-406b-a26b-d40ece85c25d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:54 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 Sep 07 16:56:54 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:55 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Deleted volume successfully. Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc04378-918a-4476-8a72-690f8245b423 tempest-VolumesAdminNegativeTest-2080539210 None] Lock "cinder-87ac0ef3-e3e3-4f12-aaab-babe8d8324c9-delete_volume" released by "delete_volume" :: held 1.991s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:55 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:55 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678 Sep 07 16:56:55 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:55 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ca49fc1b-1108-4218-a983-7c6285cc4678" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-quobyte-ca49fc1b-1108-4218-a983-7c6285cc4678" released by "delete_volume" :: held 1.163s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Created reservations ['96c02dea-7e45-4e27-bc65-a859a2a6f2c8', '9b15baf9-4bb9-4dd1-94e7-9bc9b274ebe5', '02b566bc-9726-491c-89ae-cf0cb9c94c2f', 'b0546cef-d617-4248-ac1b-abf225c5175c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:56 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:56:56 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:56 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Deleted volume successfully. Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a4a3c94-54b5-4b21-8530-c035e36e344f tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-ca49fc1b-1108-4218-a983-7c6285cc4678-delete_volume" released by "delete_volume" :: held 1.951s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "cinder-7adfb099-c8bb-4790-a300-71cbc21122b4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-7adfb099-c8bb-4790-a300-71cbc21122b4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "cinder-quobyte-7adfb099-c8bb-4790-a300-71cbc21122b4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-quobyte-7adfb099-c8bb-4790-a300-71cbc21122b4" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[18865e43-ebb5-493c-95b9-b37dc971d9ba]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:57 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 Sep 07 16:56:57 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:57 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4" returned: 0 in 0.682s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:57 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4 Sep 07 16:56:57 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:58 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7adfb099-c8bb-4790-a300-71cbc21122b4" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-quobyte-7adfb099-c8bb-4790-a300-71cbc21122b4" released by "delete_volume" :: held 1.202s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Created reservations ['ad7afb61-c791-404c-8a07-d02ed17ec986', 'cc8ada7a-9907-456c-ad2d-d8fa07ef9919', '48dfb28f-6c72-4b5d-973f-c6800325ed7e', '4c5aef27-39ad-4033-bc68-adabac126278'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:56:58 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:56:58 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:56:58 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:56:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Deleted volume successfully. Sep 07 16:56:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-374cfbf1-1b8e-4b44-a685-3ee015178aba tempest-ServerActionsTestOtherA-345339788 None] Terminate volume connection completed successfully. Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-374cfbf1-1b8e-4b44-a685-3ee015178aba tempest-ServerActionsTestOtherA-345339788 None] Deleting attachment 479a6957-55c7-40b5-ac05-a8d8c671352d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:56:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9fa3e8c2-b4a8-4636-8530-04b9df97ddf6 tempest-ServersNegativeTestJSON-1604668905 None] Lock "cinder-7adfb099-c8bb-4790-a300-71cbc21122b4-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:56:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-28e116ba-7315-4a66-9c23-db762a643658 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:56:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-28e116ba-7315-4a66-9c23-db762a643658 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:56:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-28e116ba-7315-4a66-9c23-db762a643658 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-28e116ba-7315-4a66-9c23-db762a643658 tempest-ServerActionsTestOtherA-345339788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9a8c6db-d834-4757-86b1-6ac7961c88b5', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:57:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a3593ece-dd44-4785-82c5-640275e1f1c8 req-28e116ba-7315-4a66-9c23-db762a643658 tempest-ServerActionsTestOtherA-345339788 None] attachment_update completed successfully. Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Flow 'volume_create_manager' (95086513-a8c6-4fb3-bb9a-2c41091a0bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63010b2d-2fcb-4ead-8bef-5b91d183323a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63010b2d-2fcb-4ead-8bef-5b91d183323a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1715570443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3479c6e6-bf34-4a9e-8b61-24a952eae1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e436418ee21458a81d12c12082e24c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:05Z,use_quota=True,user_id='995b4c2529034a64a98fb5098e7d85d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c8c539-eb5e-4a9f-856f-2d274bd2093f),volume_type_id=50c8c539-eb5e-4a9f-856f-2d274bd2093f)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08222b86-ebe8-4e25-8632-1706befb8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08222b86-ebe8-4e25-8632-1706befb8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a929bf2c-a20f-4527-847d-6e516c595ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a929bf2c-a20f-4527-847d-6e516c595ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3479c6e6-bf34-4a9e-8b61-24a952eae1e6', 'volume_name': 'volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25e62f9-cde4-4c2f-aac2-00f68fe9f263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b25e62f9-cde4-4c2f-aac2-00f68fe9f263) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a44852-e6e7-4a42-9669-c1a175d169f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Volume 3479c6e6-bf34-4a9e-8b61-24a952eae1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6', 'volume_size': 1} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1715570443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3479c6e6-bf34-4a9e-8b61-24a952eae1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e436418ee21458a81d12c12082e24c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:05Z,use_quota=True,user_id='995b4c2529034a64a98fb5098e7d85d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(50c8c539-eb5e-4a9f-856f-2d274bd2093f),volume_type_id=50c8c539-eb5e-4a9f-856f-2d274bd2093f)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Creating volume 3479c6e6-bf34-4a9e-8b61-24a952eae1e6 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:05 devstack sudo[90747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 1073741824 Sep 07 16:57:05 devstack sudo[90747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:05 devstack sudo[90747]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 1073741824" returned: 0 in 0.644s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:05 devstack sudo[90755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 Sep 07 16:57:05 devstack sudo[90755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:06 devstack sudo[90755]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7a44852-e6e7-4a42-9669-c1a175d169f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cdb498-7189-4374-8cd1-ba3368c926ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Volume volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 (3479c6e6-bf34-4a9e-8b61-24a952eae1e6): created successfully Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7cdb498-7189-4374-8cd1-ba3368c926ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Flow 'volume_create_manager' (95086513-a8c6-4fb3-bb9a-2c41091a0bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-66994812-2fa3-42e8-9cf4-2de0472449b8 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Created volume successfully. Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:07 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:57:07 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:08 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e3d9fc9c-5754-45c5-8e05-5af769fa6000 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Retype volume completed successfully. Sep 07 16:57:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "cinder-3479c6e6-bf34-4a9e-8b61-24a952eae1e6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "cinder-3479c6e6-bf34-4a9e-8b61-24a952eae1e6-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "cinder-quobyte-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "cinder-quobyte-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b76cff-2fe7-4501-8c44-aded1d256c93]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:09 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 Sep 07 16:57:09 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:09 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" returned: 0 in 0.426s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:09 devstack sudo[90772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6 Sep 07 16:57:09 devstack sudo[90772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:09 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:57:09 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:09 devstack sudo[90772]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "cinder-quobyte-3479c6e6-bf34-4a9e-8b61-24a952eae1e6" released by "delete_volume" :: held 0.865s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:10 devstack cinder-volume[86783]: WARNING cinder.quota [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:10 devstack cinder-volume[86783]: WARNING cinder.quota [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Created reservations ['41c84bf8-5790-4080-9b24-b6e839854f59', 'aae59f10-97fb-46f1-8fab-56fb4ead2b52', 'bf9c3594-9693-42c6-a8c7-8ce570bb6b20', '54e8412d-7dc0-4f08-94e2-620a91f0538c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:10 devstack sudo[90780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:57:10 devstack sudo[90780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:10 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.605s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 8 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:57:10 devstack sudo[90780]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.599s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Deleted volume successfully. Sep 07 16:57:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-11a3d4f6-19d1-411c-923f-55b48748acb5 tempest-VolumeRetypeWithoutMigrationTest-435305554 None] Lock "cinder-3479c6e6-bf34-4a9e-8b61-24a952eae1e6-delete_volume" released by "delete_volume" :: held 1.902s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Flow 'volume_create_manager' (4d8d0efd-b7a3-4627-8ace-270e585fcbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf303ea5-fbfd-467a-9a96-15db9a236e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf303ea5-fbfd-467a-9a96-15db9a236e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1523711879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e424e4a5-d21b-40aa-9741-9ad1f824539b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5530ada834c34331ad7e7644b216283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:19Z,use_quota=True,user_id='4ff22b2aa8804182938f4d4a25ac4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad6353-5b9c-4ebd-adc6-77bc52900499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dad6353-5b9c-4ebd-adc6-77bc52900499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7caa45-ed7b-45d2-a4c7-a93647d83967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d7caa45-ed7b-45d2-a4c7-a93647d83967) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e424e4a5-d21b-40aa-9741-9ad1f824539b', 'volume_name': 'volume-e424e4a5-d21b-40aa-9741-9ad1f824539b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b686744-39be-4de6-bc5b-6c6b4b74acdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b686744-39be-4de6-bc5b-6c6b4b74acdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f2feb9-d9e4-4bb9-9451-de4cde616518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Volume e424e4a5-d21b-40aa-9741-9ad1f824539b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e424e4a5-d21b-40aa-9741-9ad1f824539b', 'volume_size': 1} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1523711879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e424e4a5-d21b-40aa-9741-9ad1f824539b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5530ada834c34331ad7e7644b216283d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:19Z,use_quota=True,user_id='4ff22b2aa8804182938f4d4a25ac4302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Creating volume e424e4a5-d21b-40aa-9741-9ad1f824539b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:57:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:19 devstack sudo[90826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b 1073741824 Sep 07 16:57:19 devstack sudo[90826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:20 devstack sudo[90826]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b 1073741824" returned: 0 in 0.604s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:20 devstack sudo[90832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b Sep 07 16:57:20 devstack sudo[90832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:20 devstack sudo[90832]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b" returned: 0 in 0.300s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f2feb9-d9e4-4bb9-9451-de4cde616518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e424e4a5-d21b-40aa-9741-9ad1f824539b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96409f4b-5925-4570-9ee0-b98eaae452ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Volume volume-e424e4a5-d21b-40aa-9741-9ad1f824539b (e424e4a5-d21b-40aa-9741-9ad1f824539b): created successfully Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96409f4b-5925-4570-9ee0-b98eaae452ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Flow 'volume_create_manager' (4d8d0efd-b7a3-4627-8ace-270e585fcbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d1196447-48d6-49b5-aa3f-86a9ea17a2a3 tempest-VolumesServicesTestJSON-1754076615 None] Created volume successfully. Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Acquiring lock "cinder-e424e4a5-d21b-40aa-9741-9ad1f824539b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "cinder-e424e4a5-d21b-40aa-9741-9ad1f824539b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Acquiring lock "cinder-quobyte-e424e4a5-d21b-40aa-9741-9ad1f824539b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "cinder-quobyte-e424e4a5-d21b-40aa-9741-9ad1f824539b" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[786cb776-ec7f-4fc5-92ea-334f3e27c1d9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:21 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b Sep 07 16:57:21 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:22 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b" returned: 0 in 0.512s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:22 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b Sep 07 16:57:22 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:22 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e424e4a5-d21b-40aa-9741-9ad1f824539b" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "cinder-quobyte-e424e4a5-d21b-40aa-9741-9ad1f824539b" released by "delete_volume" :: held 0.906s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Created reservations ['f5a3ea7a-1443-4c81-b19b-afb47c430c98', '9336d07f-7a65-4bcc-822e-bdf06f1b90af', '704c668c-3524-4a8a-8508-d8c0626e9879', '48427a8e-7017-48f9-89a0-db4a3736a444'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:22 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:57:22 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:23 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Deleted volume successfully. Sep 07 16:57:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-780cdf05-1a6f-445c-ab95-8de5fab59006 tempest-VolumesServicesTestJSON-1754076615 None] Lock "cinder-e424e4a5-d21b-40aa-9741-9ad1f824539b-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a988324d-3060-477b-a020-040891ba5c79 req-e42eb9a7-79d6-47da-a69e-b1ce9b11b862 tempest-ServerActionsTestOtherA-345339788 None] Terminate volume connection completed successfully. Sep 07 16:57:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a988324d-3060-477b-a020-040891ba5c79 req-e42eb9a7-79d6-47da-a69e-b1ce9b11b862 tempest-ServerActionsTestOtherA-345339788 None] Deleting attachment c9a8c6db-d834-4757-86b1-6ac7961c88b5. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Flow 'volume_create_manager' (a6d4380c-92a9-464b-a409-d8b31b69fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37de733-a7d5-47ce-9971-563e4139570f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c37de733-a7d5-47ce-9971-563e4139570f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2014316575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e95a6cbc74d13be51c34502b1de0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:31Z,use_quota=True,user_id='175eb7568656487fba3793fd5691b967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6f6eeca-07d2-418f-a6de-1324de3383a2),volume_type_id=a6f6eeca-07d2-418f-a6de-1324de3383a2)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e1309-77fb-40b5-a86a-3e40ae2e06b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (838e1309-77fb-40b5-a86a-3e40ae2e06b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2d6f48-f9e8-4471-a979-8040680748b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f2d6f48-f9e8-4471-a979-8040680748b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca', 'volume_name': 'volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af21fe7-8cbd-4a78-8b69-9ea83cd3a915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9af21fe7-8cbd-4a78-8b69-9ea83cd3a915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1d16f8-2f56-42c4-a7cf-f52df9ba252d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Volume 1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca', 'volume_size': 1} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2014316575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c2e95a6cbc74d13be51c34502b1de0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:31Z,use_quota=True,user_id='175eb7568656487fba3793fd5691b967',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a6f6eeca-07d2-418f-a6de-1324de3383a2),volume_type_id=a6f6eeca-07d2-418f-a6de-1324de3383a2)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Creating volume 1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:57:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:31 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca 1073741824 Sep 07 16:57:31 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:32 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca 1073741824" returned: 0 in 0.656s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:32 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca Sep 07 16:57:32 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:32 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.190s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a1d16f8-2f56-42c4-a7cf-f52df9ba252d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8124c059-f7b7-4f82-99a4-8a85db835b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Volume volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca (1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca): created successfully Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8124c059-f7b7-4f82-99a4-8a85db835b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Flow 'volume_create_manager' (a6d4380c-92a9-464b-a409-d8b31b69fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-33a92fa2-d3a7-4a7f-bb63-82da2b70681a tempest-VolumeTypesAccessTest-237966193 None] Created volume successfully. Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Acquiring lock "cinder-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "cinder-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Acquiring lock "cinder-quobyte-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "cinder-quobyte-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55660ad-0ef1-45e4-ac40-4a5da547f578]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:34 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca Sep 07 16:57:34 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:34 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:34 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca Sep 07 16:57:34 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:34 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "cinder-quobyte-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca" released by "delete_volume" :: held 0.805s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:34 devstack cinder-volume[86783]: WARNING cinder.quota [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1956274196 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1956274196, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:34 devstack cinder-volume[86783]: WARNING cinder.quota [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1956274196 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1956274196, it is now deprecated. Please use the default quota class for default quota. Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Created reservations ['948a6135-f153-4c68-9351-b7a747788434', 'aaedfff8-1d76-4d73-888c-b9343269985c', '74ff8c0d-2339-43f4-866e-febeae2d99c0', '827476d9-9f6a-41cd-bd0f-3e727b18e037'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:34 devstack sudo[90980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:57:34 devstack sudo[90980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:35 devstack sudo[90980]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:57:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Deleted volume successfully. Sep 07 16:57:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9db12eaa-8242-40f1-9203-dc5a6eac4413 tempest-VolumeTypesAccessTest-237966193 None] Lock "cinder-1a6ccb18-46b1-4980-93e7-4bd8ea4cc1ca-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Flow 'volume_create_manager' (9c115100-6bf9-4783-8b37-217dcf1b6801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6e7a3f-7a4f-480a-8459-3c5e383c3af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c6e7a3f-7a4f-480a-8459-3c5e383c3af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1771029293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0056fa-30fe-442d-80ad-0933e62a501f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb26edd75f48e9a7078f4d54fc9403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:44Z,use_quota=True,user_id='ec9cd659319142c98fffff0993e7d8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650f437d-7ed0-46a2-9c1a-3c981be6c807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (650f437d-7ed0-46a2-9c1a-3c981be6c807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b474835f-4a22-4d35-bef6-03cd2edcc7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:44 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 16:57:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b474835f-4a22-4d35-bef6-03cd2edcc7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5f0056fa-30fe-442d-80ad-0933e62a501f', 'volume_name': 'volume-5f0056fa-30fe-442d-80ad-0933e62a501f', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1217f7c3-2e66-4374-be75-e56e0ba38905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1217f7c3-2e66-4374-be75-e56e0ba38905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0226f026-2ee4-4e1c-9c01-1ebb10552579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:45 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Volume 5f0056fa-30fe-442d-80ad-0933e62a501f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5f0056fa-30fe-442d-80ad-0933e62a501f', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 16:57:45 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Trying to clone 5f0056fa-30fe-442d-80ad-0933e62a501f from image 77b14ba4-a343-4bd3-897b-c62c1df35519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 16:57:46 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 16:57:46 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Image download 20.69 MB at 20.69 MB/s Sep 07 16:57:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[be249935-557e-4477-a724-029467d2ea35]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:46 devstack sudo[91082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD Sep 07 16:57:46 devstack sudo[91082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:47 devstack sudo[91082]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD" returned: 0 in 0.699s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 is fetched for user ec9cd659319142c98fffff0993e7d8af. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=65,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=4 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=81,cinder:SELECT=67,cinder:INSERT=14,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e418e30-bb98-4c52-bf05-1a72262d6006]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:47 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD Sep 07 16:57:47 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:48 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1771029293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f0056fa-30fe-442d-80ad-0933e62a501f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46fb26edd75f48e9a7078f4d54fc9403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:57:44Z,use_quota=True,user_id='ec9cd659319142c98fffff0993e7d8af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Creating volume 5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:57:48 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:48 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1073741824 Sep 07 16:57:48 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:48 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1073741824" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:48 devstack sudo[91099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f Sep 07 16:57:48 devstack sudo[91099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:49 devstack sudo[91099]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Attempting download of 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 5f0056fa-30fe-442d-80ad-0933e62a501f. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6dc166-b402-4cd9-9441-b64ea2007e16]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:49 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9 Sep 07 16:57:49 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:49 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9" returned: 0 in 0.427s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:49 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9 Sep 07 16:57:49 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:49 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9" returned: 1 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_81cn6oh9' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91c4f61-f421-4206-b49c-7315d35c6490]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:57:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:50 devstack sudo[91110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD Sep 07 16:57:50 devstack sudo[91110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:50 devstack sudo[91110]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD" returned: 0 in 0.498s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:50 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] 77b14ba4-a343-4bd3-897b-c62c1df35519 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 16:57:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:50 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f Sep 07 16:57:50 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:52 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f" returned: 0 in 2.230s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:52 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_jjxzt3z7devstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:57:52 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Converted 112.00 MB image at 50.20 MB/s Sep 07 16:57:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:57:52 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1G Sep 07 16:57:52 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:57:53 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f 1G" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Downloaded image 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 5f0056fa-30fe-442d-80ad-0933e62a501f successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 for user ec9cd659319142c98fffff0993e7d8af is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Marking volume 5f0056fa-30fe-442d-80ad-0933e62a501f as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Copying metadata from image 77b14ba4-a343-4bd3-897b-c62c1df35519 to 5f0056fa-30fe-442d-80ad-0933e62a501f. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Creating volume glance metadata for volume 5f0056fa-30fe-442d-80ad-0933e62a501f backed by image 77b14ba4-a343-4bd3-897b-c62c1df35519 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0226f026-2ee4-4e1c-9c01-1ebb10552579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f0056fa-30fe-442d-80ad-0933e62a501f', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de44551-481c-4fd8-8759-6a313b56155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:57:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Volume volume-5f0056fa-30fe-442d-80ad-0933e62a501f (5f0056fa-30fe-442d-80ad-0933e62a501f): created successfully Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4de44551-481c-4fd8-8759-6a313b56155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:57:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Flow 'volume_create_manager' (9c115100-6bf9-4783-8b37-217dcf1b6801) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:57:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cb942d2f-d08b-4348-8065-10c95c945f24 tempest-ServerActionsTestOtherA-345339788 None] Created volume successfully. Sep 07 16:57:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-94c79e5d-8d02-4f59-9201-6529cfd5e54f req-5f560dfc-c79a-4b99-b1bd-bc2cd081c4b7 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:57:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-94c79e5d-8d02-4f59-9201-6529cfd5e54f req-5f560dfc-c79a-4b99-b1bd-bc2cd081c4b7 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:57:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-94c79e5d-8d02-4f59-9201-6529cfd5e54f req-5f560dfc-c79a-4b99-b1bd-bc2cd081c4b7 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:57:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-94c79e5d-8d02-4f59-9201-6529cfd5e54f req-5f560dfc-c79a-4b99-b1bd-bc2cd081c4b7 tempest-ServerActionsTestOtherA-345339788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-5f0056fa-30fe-442d-80ad-0933e62a501f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '148581b4-4302-404e-bcf0-a303690f0c3b', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:57:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-94c79e5d-8d02-4f59-9201-6529cfd5e54f req-5f560dfc-c79a-4b99-b1bd-bc2cd081c4b7 tempest-ServerActionsTestOtherA-345339788 None] attachment_update completed successfully. Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Flow 'volume_create_manager' (0460aa97-460c-4cd3-9de1-6088376f348e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd28e624-91e6-4217-a9f2-540e5545d069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd28e624-91e6-4217-a9f2-540e5545d069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1111920630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59ffdd9-d91f-44fd-930b-001f62476a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c672d70415844828bd7d20ac39b6208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:02Z,use_quota=True,user_id='5dc6ddeec2e04e34b328d0353650f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09e2240-ee0d-4111-9642-51af881cc38b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e09e2240-ee0d-4111-9642-51af881cc38b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d995c-18e3-4f04-b20b-a33445e82bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133d995c-18e3-4f04-b20b-a33445e82bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c59ffdd9-d91f-44fd-930b-001f62476a70', 'volume_name': 'volume-c59ffdd9-d91f-44fd-930b-001f62476a70', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bcd254-d541-4b98-8741-cd1858c09614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34bcd254-d541-4b98-8741-cd1858c09614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aab11b-37c3-4e06-808d-8a675f62c11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Volume c59ffdd9-d91f-44fd-930b-001f62476a70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c59ffdd9-d91f-44fd-930b-001f62476a70', 'volume_size': 1} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1111920630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c59ffdd9-d91f-44fd-930b-001f62476a70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c672d70415844828bd7d20ac39b6208',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:02Z,use_quota=True,user_id='5dc6ddeec2e04e34b328d0353650f252',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Creating volume c59ffdd9-d91f-44fd-930b-001f62476a70 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:58:02 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:58:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:02 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 1073741824 Sep 07 16:58:02 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:03 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 1073741824" returned: 0 in 0.699s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:03 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 Sep 07 16:58:03 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:03 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6aab11b-37c3-4e06-808d-8a675f62c11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c59ffdd9-d91f-44fd-930b-001f62476a70', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cd3f8e-309a-4b89-9c98-ddf2803b3a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Volume volume-c59ffdd9-d91f-44fd-930b-001f62476a70 (c59ffdd9-d91f-44fd-930b-001f62476a70): created successfully Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5cd3f8e-309a-4b89-9c98-ddf2803b3a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Flow 'volume_create_manager' (0460aa97-460c-4cd3-9de1-6088376f348e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ec7ea912-09d1-4a70-a2f0-1e7fd6bee6f1 tempest-AbsoluteLimitsTests-894121774 None] Created volume successfully. Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Acquiring lock "cinder-c59ffdd9-d91f-44fd-930b-001f62476a70-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "cinder-c59ffdd9-d91f-44fd-930b-001f62476a70-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Acquiring lock "cinder-quobyte-c59ffdd9-d91f-44fd-930b-001f62476a70" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "cinder-quobyte-c59ffdd9-d91f-44fd-930b-001f62476a70" acquired by "delete_volume" :: waited 0.052s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[61887c79-9ba5-4ed4-bc6b-0018ea0c5499]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:05 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 Sep 07 16:58:05 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Flow 'volume_create_manager' (8bdb9ae3-c526-4def-b750-c290c5062123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f604a671-91c3-4901-9bbd-b0238258f641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f604a671-91c3-4901-9bbd-b0238258f641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-22574685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e5e285-605d-43a1-adc7-43f5aa38762a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c31ead05ba241c0a6508cee98b767f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:06Z,use_quota=True,user_id='8036918eb98149b8a1f9dcd7bd69b34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb6e45-1b71-48a8-97ef-e6404c171a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adeb6e45-1b71-48a8-97ef-e6404c171a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a2867d-5e68-4c62-9ca0-07ec2aaf9ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a2867d-5e68-4c62-9ca0-07ec2aaf9ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75e5e285-605d-43a1-adc7-43f5aa38762a', 'volume_name': 'volume-75e5e285-605d-43a1-adc7-43f5aa38762a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f86fb1-4cc9-4385-be8f-e7ca71d8ab34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1f86fb1-4cc9-4385-be8f-e7ca71d8ab34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10ab90b-53a4-4775-a147-23e3c4d1e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Volume 75e5e285-605d-43a1-adc7-43f5aa38762a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75e5e285-605d-43a1-adc7-43f5aa38762a', 'volume_size': 1} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-22574685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75e5e285-605d-43a1-adc7-43f5aa38762a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c31ead05ba241c0a6508cee98b767f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:06Z,use_quota=True,user_id='8036918eb98149b8a1f9dcd7bd69b34b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Creating volume 75e5e285-605d-43a1-adc7-43f5aa38762a {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:58:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:05 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70" returned: 0 in 0.630s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:05 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a 1073741824 Sep 07 16:58:05 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:05 devstack sudo[91611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70 Sep 07 16:58:05 devstack sudo[91611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (edabc499-4ebc-48f0-b736-c3356e6cfd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a17e9-7469-4699-82cd-94eae9daf734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:06 devstack sudo[91611]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c59ffdd9-d91f-44fd-930b-001f62476a70" returned: 0 in 0.708s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (942a17e9-7469-4699-82cd-94eae9daf734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-843469894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08537e51-fd91-458a-bbc8-060f8f625bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:06Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6cd241-3745-4c22-a2f3-0d0f64c6473f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a6cd241-3745-4c22-a2f3-0d0f64c6473f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb0a75-f132-410d-92a5-a4448bb56484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0afb0a75-f132-410d-92a5-a4448bb56484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08537e51-fd91-458a-bbc8-060f8f625bed', 'volume_name': 'volume-08537e51-fd91-458a-bbc8-060f8f625bed', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e92d8-17db-42f7-b5a9-f8f07d61cae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba0e92d8-17db-42f7-b5a9-f8f07d61cae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbfb958-f12b-45c2-8899-b94e7f045408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Volume 08537e51-fd91-458a-bbc8-060f8f625bed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08537e51-fd91-458a-bbc8-060f8f625bed', 'volume_size': 1} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "cinder-quobyte-c59ffdd9-d91f-44fd-930b-001f62476a70" released by "delete_volume" :: held 1.551s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:58:06 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a 1073741824" returned: 0 in 0.868s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Created reservations ['178a664e-a756-466c-baa0-8ea7d4a626ae', 'e87ac850-680d-42c3-8c02-be52dec939ea', '538014e3-27c8-440d-86f7-534b55e56e55', '555a12d2-e00e-44a9-98aa-a82d0530372b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:58:06 devstack sudo[91623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a Sep 07 16:58:06 devstack sudo[91623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:07 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:58:07 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:07 devstack sudo[91623]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] <== create_volume: return (1371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.374s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-843469894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08537e51-fd91-458a-bbc8-060f8f625bed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:06Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Creating volume 08537e51-fd91-458a-bbc8-060f8f625bed {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:58:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e10ab90b-53a4-4775-a147-23e3c4d1e51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75e5e285-605d-43a1-adc7-43f5aa38762a', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:07 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed 1073741824 Sep 07 16:58:07 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cc8786-2b98-48fe-af85-522146a86f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Volume volume-75e5e285-605d-43a1-adc7-43f5aa38762a (75e5e285-605d-43a1-adc7-43f5aa38762a): created successfully Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cc8786-2b98-48fe-af85-522146a86f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Flow 'volume_create_manager' (8bdb9ae3-c526-4def-b750-c290c5062123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e10f980-fc8f-4c3b-9479-cc4ab24a1cd3 tempest-TaggedAttachmentsTest-1737014531 None] Created volume successfully. Sep 07 16:58:07 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:58:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Deleted volume successfully. Sep 07 16:58:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f1021eaf-cc1b-4e1f-8ca6-254d4d0835d2 tempest-AbsoluteLimitsTests-894121774 None] Lock "cinder-c59ffdd9-d91f-44fd-930b-001f62476a70-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:58:08 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed 1073741824" returned: 0 in 1.025s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:08 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed Sep 07 16:58:08 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:08 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fbfb958-f12b-45c2-8899-b94e7f045408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08537e51-fd91-458a-bbc8-060f8f625bed', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26882fc-e230-4371-b3cd-d334961c3836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Volume volume-08537e51-fd91-458a-bbc8-060f8f625bed (08537e51-fd91-458a-bbc8-060f8f625bed): created successfully Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e26882fc-e230-4371-b3cd-d334961c3836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (edabc499-4ebc-48f0-b736-c3356e6cfd87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f4ab9d27-8cb2-4158-a54a-eda3007334ca tempest-AttachVolumeNegativeTest-704001503 None] Created volume successfully. Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:09 devstack sudo[91652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:58:09 devstack sudo[91652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:10 devstack sudo[91652]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.637s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:58:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:58:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:58:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:58:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-76dd727c-bc03-4db3-9cb4-182a8c3a172c req-d09e6abd-6bca-424b-9019-7a905c665f9e tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-76dd727c-bc03-4db3-9cb4-182a8c3a172c req-d09e6abd-6bca-424b-9019-7a905c665f9e tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-76dd727c-bc03-4db3-9cb4-182a8c3a172c req-d09e6abd-6bca-424b-9019-7a905c665f9e tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-76dd727c-bc03-4db3-9cb4-182a8c3a172c req-d09e6abd-6bca-424b-9019-7a905c665f9e tempest-AttachVolumeNegativeTest-704001503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-08537e51-fd91-458a-bbc8-060f8f625bed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30258fd4-ca51-49e1-8264-963c7bd84c04', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:58:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-76dd727c-bc03-4db3-9cb4-182a8c3a172c req-d09e6abd-6bca-424b-9019-7a905c665f9e tempest-AttachVolumeNegativeTest-704001503 None] attachment_update completed successfully. Sep 07 16:58:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-7765a7ee-1565-41c0-a944-2d21342fcc63 tempest-ServerActionsTestOtherA-345339788 None] Terminate volume connection completed successfully. Sep 07 16:58:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-7765a7ee-1565-41c0-a944-2d21342fcc63 tempest-ServerActionsTestOtherA-345339788 None] Deleting attachment 148581b4-4302-404e-bcf0-a303690f0c3b. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:58:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-26c1a1bd-c0ba-40f7-b550-51a3409f6bbe tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-26c1a1bd-c0ba-40f7-b550-51a3409f6bbe tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-26c1a1bd-c0ba-40f7-b550-51a3409f6bbe tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-26c1a1bd-c0ba-40f7-b550-51a3409f6bbe tempest-ServerActionsTestOtherA-345339788 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-5f0056fa-30fe-442d-80ad-0933e62a501f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a0432c6d-d5b4-40cf-b79e-f475a3058638', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:58:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a8ec2653-6ddc-474d-b4cf-9fc87df38988 req-26c1a1bd-c0ba-40f7-b550-51a3409f6bbe tempest-ServerActionsTestOtherA-345339788 None] attachment_update completed successfully. Sep 07 16:58:34 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=8,cinder:UPDATE=28,cinder:SELECT=41,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:34 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=38,cinder:INSERT=13,cinder:UPDATE=24,cinder:DELETE=4 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Flow 'volume_create_manager' (080eac12-8847-494f-899d-2797e345c113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c3bb23-7565-4b74-bf4d-1c62da59808f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0c3bb23-7565-4b74-bf4d-1c62da59808f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079770219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd594c9-5669-4916-bd93-fb85c8f43704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b02f70fc78499c871949d248d14ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:39Z,use_quota=True,user_id='0808e267c1ec4440a30a3f371d499ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723faac8-12cb-43ed-b467-c60dcfbb6d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723faac8-12cb-43ed-b467-c60dcfbb6d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc27cec-c383-42dc-8c5e-0712bedd40dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdc27cec-c383-42dc-8c5e-0712bedd40dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd594c9-5669-4916-bd93-fb85c8f43704', 'volume_name': 'volume-6cd594c9-5669-4916-bd93-fb85c8f43704', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4920e5ec-7ebb-4621-a1fe-17c7641478eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4920e5ec-7ebb-4621-a1fe-17c7641478eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea9ca6e-2230-49ec-aa51-5f3625e34b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:38 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Volume 6cd594c9-5669-4916-bd93-fb85c8f43704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd594c9-5669-4916-bd93-fb85c8f43704', 'volume_size': 1} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T14:58:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1079770219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd594c9-5669-4916-bd93-fb85c8f43704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42b02f70fc78499c871949d248d14ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T14:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T14:58:39Z,use_quota=True,user_id='0808e267c1ec4440a30a3f371d499ce4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Creating volume 6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 16:58:38 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 16:58:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:39 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 1073741824 Sep 07 16:58:39 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:39 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 1073741824" returned: 0 in 1.006s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:58:40 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:58:40 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:58:40 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.690s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea9ca6e-2230-49ec-aa51-5f3625e34b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd594c9-5669-4916-bd93-fb85c8f43704', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918b883-2c5a-4880-bef4-81ae101faa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 16:58:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Volume volume-6cd594c9-5669-4916-bd93-fb85c8f43704 (6cd594c9-5669-4916-bd93-fb85c8f43704): created successfully Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7918b883-2c5a-4880-bef4-81ae101faa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 16:58:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Flow 'volume_create_manager' (080eac12-8847-494f-899d-2797e345c113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 16:58:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-67ea2646-3bde-4e84-903a-117784387ffe tempest-VolumesActionsTest-1873897202 None] Created volume successfully. Sep 07 16:58:50 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:50 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f457d6d4-3482-4235-ad9a-01d288628cde tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f457d6d4-3482-4235-ad9a-01d288628cde tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" acquired by "attach_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f457d6d4-3482-4235-ad9a-01d288628cde tempest-VolumesActionsTest-1873897202 None] Attaching volume 6cd594c9-5669-4916-bd93-fb85c8f43704 to instance 441b8c1d-d078-4071-bdbe-db53ccfff888 at mountpoint /dev/vdb on host None. Sep 07 16:58:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f457d6d4-3482-4235-ad9a-01d288628cde tempest-VolumesActionsTest-1873897202 None] Attach volume completed successfully. Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f457d6d4-3482-4235-ad9a-01d288628cde tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" released by "attach_volume" :: held 0.101s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5a64a9-84df-405a-9927-dee10f990b9f tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5a64a9-84df-405a-9927-dee10f990b9f tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:58:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ac5a64a9-84df-405a-9927-dee10f990b9f tempest-VolumesActionsTest-1873897202 None] Detaching volume 6cd594c9-5669-4916-bd93-fb85c8f43704 from instance 441b8c1d-d078-4071-bdbe-db53ccfff888. Sep 07 16:58:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ac5a64a9-84df-405a-9927-dee10f990b9f tempest-VolumesActionsTest-1873897202 None] Detach volume completed successfully. Sep 07 16:58:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5a64a9-84df-405a-9927-dee10f990b9f tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:02 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=2,cinder:SELECT=5,cinder:UPDATE=4 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:02 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f954b4-274a-4d92-8a11-38f7c72b2b31 tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f954b4-274a-4d92-8a11-38f7c72b2b31 tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" acquired by "attach_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-41f954b4-274a-4d92-8a11-38f7c72b2b31 tempest-VolumesActionsTest-1873897202 None] Attaching volume 6cd594c9-5669-4916-bd93-fb85c8f43704 to instance 264c9af8-5e42-4bbf-837a-1d25e3dd06cf at mountpoint /dev/vdb on host None. Sep 07 16:59:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-41f954b4-274a-4d92-8a11-38f7c72b2b31 tempest-VolumesActionsTest-1873897202 None] Attach volume completed successfully. Sep 07 16:59:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f954b4-274a-4d92-8a11-38f7c72b2b31 tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704" released by "attach_volume" :: held 0.217s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-418e5fbe-5322-4af9-860a-4ed2bebcdb74 tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-418e5fbe-5322-4af9-860a-4ed2bebcdb74 tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-418e5fbe-5322-4af9-860a-4ed2bebcdb74 tempest-VolumesActionsTest-1873897202 None] Detaching volume 6cd594c9-5669-4916-bd93-fb85c8f43704 from instance 264c9af8-5e42-4bbf-837a-1d25e3dd06cf. Sep 07 16:59:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-418e5fbe-5322-4af9-860a-4ed2bebcdb74 tempest-VolumesActionsTest-1873897202 None] Detach volume completed successfully. Sep 07 16:59:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-418e5fbe-5322-4af9-860a-4ed2bebcdb74 tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-detach_volume" released by "detach_volume" :: held 0.199s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-2d1911da-4ec5-466f-9202-206ecce74e38 tempest-ServerActionsTestOtherA-345339788 None] Terminate volume connection completed successfully. Sep 07 16:59:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-2d1911da-4ec5-466f-9202-206ecce74e38 tempest-ServerActionsTestOtherA-345339788 None] Deleting attachment a0432c6d-d5b4-40cf-b79e-f475a3058638. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-8954f88d-9f3a-4347-8a4b-a0e2b28b1ca4 req-e42ee06a-5aab-4729-b50c-e32fbc92b1b2 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-8954f88d-9f3a-4347-8a4b-a0e2b28b1ca4 req-e42ee06a-5aab-4729-b50c-e32fbc92b1b2 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "cinder-5f0056fa-30fe-442d-80ad-0933e62a501f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-8954f88d-9f3a-4347-8a4b-a0e2b28b1ca4 req-e42ee06a-5aab-4729-b50c-e32fbc92b1b2 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-5f0056fa-30fe-442d-80ad-0933e62a501f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "cinder-quobyte-5f0056fa-30fe-442d-80ad-0933e62a501f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8954f88d-9f3a-4347-8a4b-a0e2b28b1ca4 req-e42ee06a-5aab-4729-b50c-e32fbc92b1b2 tempest-TaggedAttachmentsTest-1737014531 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-75e5e285-605d-43a1-adc7-43f5aa38762a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '66f66331-8bf7-44e2-9288-e23697b01682', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-quobyte-5f0056fa-30fe-442d-80ad-0933e62a501f" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ddc641-4493-497d-b10b-b0854da3f4d3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8954f88d-9f3a-4347-8a4b-a0e2b28b1ca4 req-e42ee06a-5aab-4729-b50c-e32fbc92b1b2 tempest-TaggedAttachmentsTest-1737014531 None] attachment_update completed successfully. Sep 07 16:59:08 devstack sudo[92444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f Sep 07 16:59:08 devstack sudo[92444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack sudo[92444]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f" returned: 0 in 0.775s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:09 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f Sep 07 16:59:09 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "cinder-13fd08ac-0635-495a-a29c-35f3fe81c6f5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:09 devstack sudo[92461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:59:09 devstack sudo[92461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-13fd08ac-0635-495a-a29c-35f3fe81c6f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:09 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5f0056fa-30fe-442d-80ad-0933e62a501f" returned: 0 in 0.572s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "cinder-quobyte-13fd08ac-0635-495a-a29c-35f3fe81c6f5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-quobyte-5f0056fa-30fe-442d-80ad-0933e62a501f" released by "delete_volume" :: held 1.465s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-quobyte-13fd08ac-0635-495a-a29c-35f3fe81c6f5" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[08ba0b77-3c6b-4221-b231-d62ebf61f92b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.quota [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Created reservations ['2c1b57c2-9579-48b9-96b3-700e1503de54', 'e90c5c65-9729-4f88-9e23-4a3403de6486', '48c8e3da-1c9a-4306-8cdb-1faaf0c17eed', '9046cf9e-18bf-48d2-985b-61e7581a139b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:10 devstack sudo[92461]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:10 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 Sep 07 16:59:10 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:10 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:59:10 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:10 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.manager [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Deleted volume successfully. Sep 07 16:59:10 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5" returned: 0 in 0.620s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:10 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5 Sep 07 16:59:10 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-ca440c9e-8040-4184-9a55-4ec38aabe840 req-d85f9a0d-7e0f-44cd-98ca-f9adebe3fa32 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-5f0056fa-30fe-442d-80ad-0933e62a501f-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:10 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-13fd08ac-0635-495a-a29c-35f3fe81c6f5" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-quobyte-13fd08ac-0635-495a-a29c-35f3fe81c6f5" released by "delete_volume" :: held 1.071s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Created reservations ['8b420ead-f756-4d4c-94c1-b5522ff6e10a', '99c6b95b-42bb-4366-8d37-17caa6f8df2d', 'bd1a15d4-c3df-4d84-ba0d-0e6c54630300', '232f621c-6330-47b8-b26b-f4331a75c0ff'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:11 devstack sudo[92480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:59:11 devstack sudo[92480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:11 devstack sudo[92480]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Deleted volume successfully. Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-957a10e3-42e7-4ec2-bb25-9c3cf28b6d73 tempest-ServerActionsTestOtherA-345339788 None] Lock "cinder-13fd08ac-0635-495a-a29c-35f3fe81c6f5-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-888c4de4-8087-47d6-bdac-c5c71eb378ff req-8998d832-7e1b-4bdf-af40-1ce0944c68cb tempest-TaggedAttachmentsTest-1737014531 None] Terminate volume connection completed successfully. Sep 07 16:59:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-888c4de4-8087-47d6-bdac-c5c71eb378ff req-8998d832-7e1b-4bdf-af40-1ce0944c68cb tempest-TaggedAttachmentsTest-1737014531 None] Deleting attachment 66f66331-8bf7-44e2-9288-e23697b01682. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:59:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6ba2b3-7d47-48a2-af40-00bd320d2faf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:14 devstack sudo[92552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:59:14 devstack sudo[92552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:14 devstack sudo[92552]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ad3747-a55c-4ae6-9d97-0356704b2559]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:14 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:59:14 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-585ae352-16ab-4436-963a-91ffe2d490c5 req-e2291777-5d3d-458f-aa1a-ca988d2253f9 tempest-AttachVolumeNegativeTest-704001503 None] Terminate volume connection completed successfully. Sep 07 16:59:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-585ae352-16ab-4436-963a-91ffe2d490c5 req-e2291777-5d3d-458f-aa1a-ca988d2253f9 tempest-AttachVolumeNegativeTest-704001503 None] Deleting attachment 30258fd4-ca51-49e1-8264-963c7bd84c04. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 16:59:15 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.642s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.fbfb4bb4-fee7-4941-adaf-8217b0bbbf92cgmd8ndy.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:15 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.fbfb4bb4-fee7-4941-adaf-8217b0bbbf92cgmd8ndy.img Sep 07 16:59:15 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:21 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.fbfb4bb4-fee7-4941-adaf-8217b0bbbf92cgmd8ndy.img" returned: 0 in 6.175s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee17a58-08ad-40a6-ade4-2f3b9b37ca51]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:21 devstack sudo[92640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:59:21 devstack sudo[92640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:21 devstack sudo[92640]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.673s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.fbfb4bb4-fee7-4941-adaf-8217b0bbbf92cgmd8ndy.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 16:59:21 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Converted 1024.00 MB image at 165.79 MB/s Sep 07 16:59:21 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] fbfb4bb4-fee7-4941-adaf-8217b0bbbf92 was raw, no need to convert to raw {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 16:59:24 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=25,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "cinder-75e5e285-605d-43a1-adc7-43f5aa38762a-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "cinder-75e5e285-605d-43a1-adc7-43f5aa38762a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "cinder-quobyte-75e5e285-605d-43a1-adc7-43f5aa38762a" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "cinder-quobyte-75e5e285-605d-43a1-adc7-43f5aa38762a" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc049d1-7667-4990-90d3-1542a1d922c2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:28 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a Sep 07 16:59:28 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:29 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:29 devstack sudo[92664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a Sep 07 16:59:29 devstack sudo[92664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:29 devstack sudo[92664]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-75e5e285-605d-43a1-adc7-43f5aa38762a" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "cinder-quobyte-75e5e285-605d-43a1-adc7-43f5aa38762a" released by "delete_volume" :: held 0.907s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Created reservations ['788e5476-f6b3-434b-95ae-e1e99bd3372b', 'aa5569b6-f5e4-40d2-85a5-6d62baae50da', 'd79d928f-b6d0-429b-b0ba-5acb705dc851', 'e98c63e9-8841-434f-8a5a-0be19537d5bc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:29 devstack sudo[92667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 16:59:29 devstack sudo[92667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:30 devstack sudo[92667]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 16:59:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Deleted volume successfully. Sep 07 16:59:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6ed762a7-c6a3-4900-bdb9-8909bbad46f6 tempest-TaggedAttachmentsTest-1737014531 None] Lock "cinder-75e5e285-605d-43a1-adc7-43f5aa38762a-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 16:59:39 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:40 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:INSERT=6,cinder:SELECT=38,cinder:UPDATE=28,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 16:59:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 36.061s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 16:59:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Uploaded volume to glance image-id: fbfb4bb4-fee7-4941-adaf-8217b0bbbf92. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 16:59:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-472f49c3-1020-4758-95b0-69e895bfae79 tempest-VolumesActionsTest-1873897202 None] Copy volume to image completed successfully. Sep 07 16:59:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 16:59:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 16:59:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c11f2-5967-4f5e-8014-2107937e2dee]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:53 devstack sudo[92809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:59:53 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:53 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8ad4f0-2e11-4fb5-8057-a9408ba5f34c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 16:59:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:53 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 16:59:53 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 16:59:54 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Sep 07 16:59:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.584s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 16:59:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 16:59:54 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img Sep 07 16:59:54 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img" returned: 0 in 5.965s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31a2ecc-b51b-4948-996c-915782494c69]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:00 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 17:00:00 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:00 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.599s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704, size 1024.00 MB, duration 5.97 sec, destination /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:00:00 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Converted 1024.00 MB image at 171.64 MB/s Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] 6c0b1941-e4e1-4330-a9e2-01666971fbcb was raw, converting to qcow2 {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[070727e5-cb6a-415f-95e7-3c04872d2185]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:00 devstack sudo[92890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img Sep 07 17:00:00 devstack sudo[92890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Flow 'volume_create_manager' (a93b6a09-5384-4e5e-b8bc-75aa0c0cb2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5640f-ebfd-4cc4-b0d9-f9bd95e38d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a5640f-ebfd-4cc4-b0d9-f9bd95e38d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1944049134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3b5c79-f966-4246-90f9-bf47d82adc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd39292247d043b4b87115dee7b42c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:01Z,use_quota=True,user_id='2ef4d0584cae42a0be34077b1e835e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370241ba-5856-435a-81ca-97ad02e70911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (370241ba-5856-435a-81ca-97ad02e70911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63293acd-ec12-4628-aad2-a9f22cd2cf87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63293acd-ec12-4628-aad2-a9f22cd2cf87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d3b5c79-f966-4246-90f9-bf47d82adc51', 'volume_name': 'volume-0d3b5c79-f966-4246-90f9-bf47d82adc51', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5032b6e-196f-4aba-8ba4-36f110af7183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5032b6e-196f-4aba-8ba4-36f110af7183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93cd457-07d4-45be-99ab-687496d7a564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Volume 0d3b5c79-f966-4246-90f9-bf47d82adc51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d3b5c79-f966-4246-90f9-bf47d82adc51', 'volume_size': 1} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:01 devstack sudo[92890]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img" returned: 0 in 0.437s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:01 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img Sep 07 17:00:01 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:01 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img" returned: 1 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img /opt/stack/data/cinder/conversion/vol_upload_epoexeak {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:01 devstack sudo[92900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img /opt/stack/data/cinder/conversion/vol_upload_epoexeak Sep 07 17:00:01 devstack sudo[92900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:01 devstack sudo[92900]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img /opt/stack/data/cinder/conversion/vol_upload_epoexeak" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:02 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Image conversion details: src /opt/stack/data/cinder/conversion/6cd594c9-5669-4916-bd93-fb85c8f43704.temp_image.6c0b1941-e4e1-4330-a9e2-01666971fbcbhme6f2fy.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_epoexeak {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:00:02 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 17:00:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b639200-77f0-425d-9644-6a284be26b66]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_epoexeak {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:02 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_epoexeak Sep 07 17:00:02 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:02 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_epoexeak" returned: 0 in 0.496s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.898s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Uploaded volume to glance image-id: 6c0b1941-e4e1-4330-a9e2-01666971fbcb. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.871s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1944049134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d3b5c79-f966-4246-90f9-bf47d82adc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd39292247d043b4b87115dee7b42c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:01Z,use_quota=True,user_id='2ef4d0584cae42a0be34077b1e835e3f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Creating volume 0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:04 devstack sudo[92986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 1073741824 Sep 07 17:00:04 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6084a4c-294a-48ff-adc5-b6395e429bf0 tempest-VolumesActionsTest-1873897202 None] Copy volume to image completed successfully. Sep 07 17:00:05 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 1073741824" returned: 0 in 0.692s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:05 devstack sudo[92993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 Sep 07 17:00:05 devstack sudo[92993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:05 devstack sudo[92993]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b93cd457-07d4-45be-99ab-687496d7a564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d3b5c79-f966-4246-90f9-bf47d82adc51', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec134de-ce6c-4bcf-9774-0abe86d9cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Volume volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 (0d3b5c79-f966-4246-90f9-bf47d82adc51): created successfully Sep 07 17:00:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ec134de-ce6c-4bcf-9774-0abe86d9cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Flow 'volume_create_manager' (a93b6a09-5384-4e5e-b8bc-75aa0c0cb2a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c71b0b02-f925-4dcd-ac2d-169a913c7102 req-639cc0a0-11c7-4881-8f96-1458dc7ce828 tempest-VolumesSnapshotsTestJSON-307453910 None] Created volume successfully. Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Acquiring lock "cinder-quobyte-6cd594c9-5669-4916-bd93-fb85c8f43704" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "cinder-quobyte-6cd594c9-5669-4916-bd93-fb85c8f43704" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6035d807-7e91-40ee-84a0-00b65d07649e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:06 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 17:00:06 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Creating offline snapshot d939e57a-b71e-4e51-99e8-a5c7a5063d35 of volume 0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[07595637-216d-4411-ac0d-5434f27c9dcc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:07 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 Sep 07 17:00:07 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:07 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.539s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:07 devstack sudo[93007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704 Sep 07 17:00:07 devstack sudo[93007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:07 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:07 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 1G Sep 07 17:00:07 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:07 devstack sudo[93007]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cd594c9-5669-4916-bd93-fb85c8f43704" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "cinder-quobyte-6cd594c9-5669-4916-bd93-fb85c8f43704" released by "delete_volume" :: held 0.907s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Created reservations ['46cf7385-e069-4a60-87f1-18d9fe612e78', '87f14a58-761a-4523-ae79-d4be37a3bcb4', '9f5076b1-4218-4782-8401-b3d66dcd1d96', '227f5b88-0215-440c-be35-391516850e01'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:07 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:07 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:08 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 1G" returned: 0 in 0.490s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:08 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:08 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 Sep 07 17:00:08 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Deleted volume successfully. Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e05c34a-0887-4ed4-94a8-bccf82dacafc tempest-VolumesActionsTest-1873897202 None] Lock "cinder-6cd594c9-5669-4916-bd93-fb85c8f43704-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:08 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 is being set with open permissions: ugo+rw Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:08 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 Sep 07 17:00:08 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:08 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:08 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info Sep 07 17:00:08 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:09 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:09 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info is being set with open permissions: ugo+rw Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:09 devstack sudo[93035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info Sep 07 17:00:09 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:09 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.info" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.347s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c80048d8-22ac-45bc-aa3d-7ea7884ec138 req-967fdbda-d53b-4883-abfb-558e1c745ead tempest-VolumesSnapshotsTestJSON-307453910 None] Create snapshot completed successfully Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "cinder-d939e57a-b71e-4e51-99e8-a5c7a5063d35-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-d939e57a-b71e-4e51-99e8-a5c7a5063d35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "cinder-quobyte-d939e57a-b71e-4e51-99e8-a5c7a5063d35" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-d939e57a-b71e-4e51-99e8-a5c7a5063d35" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Deleting offline snapshot d939e57a-b71e-4e51-99e8-a5c7a5063d35 of volume 0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] snapshot_file for this snap is: volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e604c7-e9eb-4fd2-8a42-2a8977bfdf79]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:09 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:09 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:09 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 Sep 07 17:00:09 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:10 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:00:10 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35" returned: 0 in 0.537s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d3b5c79-f966-4246-90f9-bf47d82adc51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b890cab-daf5-49cf-ae5e-08765d689f94]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:10 devstack sudo[93050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 Sep 07 17:00:10 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:10 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51" returned: 0 in 0.546s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:10 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 Sep 07 17:00:10 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (5054fe62-9ee3-4e66-90a7-695247023023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c6ec9a-cd64-4d45-94a3-8f3627b593a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56c6ec9a-cd64-4d45-94a3-8f3627b593a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1553663966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cc4b96-ce46-4097-a735-acaf5e1f722b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:11Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87feaea-47c1-47d2-944b-ff0c9d184c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87feaea-47c1-47d2-944b-ff0c9d184c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d963441-c960-4f61-8e32-c69ff7292fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d963441-c960-4f61-8e32-c69ff7292fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90cc4b96-ce46-4097-a735-acaf5e1f722b', 'volume_name': 'volume-90cc4b96-ce46-4097-a735-acaf5e1f722b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabcb438-a041-4567-b832-90e13f7ce371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabcb438-a041-4567-b832-90e13f7ce371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fb604d-dd25-4bb8-98e4-8ceb1f189441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Volume 90cc4b96-ce46-4097-a735-acaf5e1f722b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90cc4b96-ce46-4097-a735-acaf5e1f722b', 'volume_size': 1} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1553663966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90cc4b96-ce46-4097-a735-acaf5e1f722b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:11Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Creating volume 90cc4b96-ce46-4097-a735-acaf5e1f722b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:11 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b 1073741824 Sep 07 17:00:11 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:11 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:11 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35 Sep 07 17:00:11 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:11 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b 1073741824" returned: 0 in 0.427s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:11 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51.d939e57a-b71e-4e51-99e8-a5c7a5063d35" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:11 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b Sep 07 17:00:11 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-d939e57a-b71e-4e51-99e8-a5c7a5063d35" released by "_delete_snapshot" :: held 1.902s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" released by "delete_snapshot" :: held 1.931s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:11 devstack cinder-volume[86783]: WARNING cinder.quota [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.quota [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Created reservations ['288e8f86-49f0-4a82-841b-8ec5d64d8f17', 'e5caf721-b516-4b77-aae2-05d1f58773a5', '5d60d0c8-b33d-4d75-b2f8-b7136bb90c98', '57b7689a-2036-4f8e-869f-97c16445a3df'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Delete snapshot completed successfully. Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a9fdb2c3-d67e-436a-968f-0f10966a1ce8 req-62c005e5-5092-4fb1-bbf3-11d391142a53 tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-d939e57a-b71e-4e51-99e8-a5c7a5063d35-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:11 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58fb604d-dd25-4bb8-98e4-8ceb1f189441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90cc4b96-ce46-4097-a735-acaf5e1f722b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302ebc8-6045-4afe-88c1-a2ee855bcc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Volume volume-90cc4b96-ce46-4097-a735-acaf5e1f722b (90cc4b96-ce46-4097-a735-acaf5e1f722b): created successfully Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4302ebc8-6045-4afe-88c1-a2ee855bcc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (5054fe62-9ee3-4e66-90a7-695247023023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-60d49dc2-a396-4aa6-9503-dd575f648536 tempest-AttachVolumeNegativeTest-704001503 None] Created volume successfully. Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "cinder-0d3b5c79-f966-4246-90f9-bf47d82adc51-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-0d3b5c79-f966-4246-90f9-bf47d82adc51-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda8a2f2-1ca4-426d-b049-e5688e81b68a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:12 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 Sep 07 17:00:12 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:12 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51" returned: 0 in 0.417s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:12 devstack sudo[93078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51 Sep 07 17:00:12 devstack sudo[93078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:12 devstack sudo[93078]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0d3b5c79-f966-4246-90f9-bf47d82adc51" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-quobyte-0d3b5c79-f966-4246-90f9-bf47d82adc51" released by "delete_volume" :: held 0.888s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG cinder.quota [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Created reservations ['bf4deae3-a69e-4eda-b9e6-4bdfa18c49cf', 'dd140d36-08f0-4edf-a940-7f174b17452c', 'ac78e432-11b0-4205-9b74-9bdfab23d540', '6d3cd050-7123-4fd9-a1f3-490b9a65a3f2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:13 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:13 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:13 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.587s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:13 devstack cinder-volume[86783]: DEBUG cinder.manager [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Deleted volume successfully. Sep 07 17:00:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-aec62fa9-57db-446b-bdd6-1a207ef5d8ae req-742ec7ee-3eb4-4d40-b78b-7c179ee5326c tempest-VolumesSnapshotsTestJSON-307453910 None] Lock "cinder-0d3b5c79-f966-4246-90f9-bf47d82adc51-delete_volume" released by "delete_volume" :: held 1.982s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-47c30e58-7322-4d7d-a3b7-f31af0750948 req-3c05d3fe-fa34-4550-a574-31844a646557 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-47c30e58-7322-4d7d-a3b7-f31af0750948 req-3c05d3fe-fa34-4550-a574-31844a646557 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-47c30e58-7322-4d7d-a3b7-f31af0750948 req-3c05d3fe-fa34-4550-a574-31844a646557 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-47c30e58-7322-4d7d-a3b7-f31af0750948 req-3c05d3fe-fa34-4550-a574-31844a646557 tempest-AttachVolumeNegativeTest-704001503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-90cc4b96-ce46-4097-a735-acaf5e1f722b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b985b6b5-2736-42f7-83ee-9296d6d3427f', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:00:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-47c30e58-7322-4d7d-a3b7-f31af0750948 req-3c05d3fe-fa34-4550-a574-31844a646557 tempest-AttachVolumeNegativeTest-704001503 None] attachment_update completed successfully. Sep 07 17:00:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-5633866e-d9f4-4f15-87c3-fe271c080624 req-e326b2e8-a3e0-4292-a7ee-35c2e54218a8 tempest-AttachVolumeNegativeTest-704001503 None] Terminate volume connection completed successfully. Sep 07 17:00:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-5633866e-d9f4-4f15-87c3-fe271c080624 req-e326b2e8-a3e0-4292-a7ee-35c2e54218a8 tempest-AttachVolumeNegativeTest-704001503 None] Deleting attachment b985b6b5-2736-42f7-83ee-9296d6d3427f. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (b33d4f55-8c72-4334-8b79-0fd348ca5586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1960b51a-346d-4d26-be06-884f31934d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1960b51a-346d-4d26-be06-884f31934d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-316634235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48279807-0336-441d-9a0b-169b81fba271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:19Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8068dff0-4fc8-4616-af57-fb3a034ec466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8068dff0-4fc8-4616-af57-fb3a034ec466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872aea42-7553-4785-bc18-49a32b3386df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872aea42-7553-4785-bc18-49a32b3386df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48279807-0336-441d-9a0b-169b81fba271', 'volume_name': 'volume-48279807-0336-441d-9a0b-169b81fba271', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c666e8-273b-41aa-a6fa-861b0b1f76cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3c666e8-273b-41aa-a6fa-861b0b1f76cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e175f9a-7c48-4c63-aea3-7bd7ae750c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Volume 48279807-0336-441d-9a0b-169b81fba271: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48279807-0336-441d-9a0b-169b81fba271', 'volume_size': 1} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-316634235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48279807-0336-441d-9a0b-169b81fba271,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:19Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Creating volume 48279807-0336-441d-9a0b-169b81fba271 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:19 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 1073741824 Sep 07 17:00:19 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:20 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 1073741824" returned: 0 in 0.599s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:20 devstack sudo[93579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 Sep 07 17:00:20 devstack sudo[93579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:20 devstack sudo[93579]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e175f9a-7c48-4c63-aea3-7bd7ae750c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48279807-0336-441d-9a0b-169b81fba271', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881605ce-7eb7-4fe8-886f-779b1ef9bcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Volume volume-48279807-0336-441d-9a0b-169b81fba271 (48279807-0336-441d-9a0b-169b81fba271): created successfully Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (881605ce-7eb7-4fe8-886f-779b1ef9bcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (b33d4f55-8c72-4334-8b79-0fd348ca5586) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5cee70de-a01b-41ce-b636-75baad424ed9 tempest-VolumesTestJSON-1424261006 None] Created volume successfully. Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (02bab118-1c4c-4794-9d92-b0350b2f2760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7c9e7-cb82-46eb-bf3a-5c9c251da1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f7c9e7-cb82-46eb-bf3a-5c9c251da1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-869679366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b60006-d4f7-4b6e-a5a8-45788b5a5df2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:22Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827375e8-ef64-4c52-82da-e4a65c65f820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (827375e8-ef64-4c52-82da-e4a65c65f820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849e1ef-b345-49b4-b584-cefa00867f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5849e1ef-b345-49b4-b584-cefa00867f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2b60006-d4f7-4b6e-a5a8-45788b5a5df2', 'volume_name': 'volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf4b25e-bfdf-4236-8a30-da96c13a065d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cf4b25e-bfdf-4236-8a30-da96c13a065d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8643112-5068-4824-8f0a-ca598281bc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Volume d2b60006-d4f7-4b6e-a5a8-45788b5a5df2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2', 'volume_size': 1} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-869679366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2b60006-d4f7-4b6e-a5a8-45788b5a5df2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:22Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Creating volume d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:22 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:22 devstack sudo[93583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 1073741824 Sep 07 17:00:22 devstack sudo[93583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:22 devstack sudo[93583]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 1073741824" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Flow 'volume_create_manager' (07f70b05-ea39-4965-ad88-772d12f35150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d28cf84-3563-42b6-a7d9-004648e192b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d28cf84-3563-42b6-a7d9-004648e192b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2136430496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b514f6d-dbf5-4078-81b2-48d0148420b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25244a2390942e09e5abd1f8c2fedba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:23Z,use_quota=True,user_id='7f940538d521475ebe8e7cdd5ab73677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc10a57-9487-4f21-bdb4-fdb25cc74543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bc10a57-9487-4f21-bdb4-fdb25cc74543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48131d5a-c9c9-4432-b715-8f4fc5cc20d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48131d5a-c9c9-4432-b715-8f4fc5cc20d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b514f6d-dbf5-4078-81b2-48d0148420b8', 'volume_name': 'volume-7b514f6d-dbf5-4078-81b2-48d0148420b8', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0afcac-5896-4d99-9990-ec3fed77a66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d0afcac-5896-4d99-9990-ec3fed77a66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8158424-c94d-4897-8cbb-b4d5b3212783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Volume 7b514f6d-dbf5-4078-81b2-48d0148420b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b514f6d-dbf5-4078-81b2-48d0148420b8', 'volume_size': 2} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:22 devstack sudo[93590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 Sep 07 17:00:22 devstack sudo[93590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:23 devstack sudo[93590]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2136430496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b514f6d-dbf5-4078-81b2-48d0148420b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b25244a2390942e09e5abd1f8c2fedba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:23Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:23Z,use_quota=True,user_id='7f940538d521475ebe8e7cdd5ab73677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Creating volume 7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 2147483648 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8643112-5068-4824-8f0a-ca598281bc51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:23 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 2147483648 Sep 07 17:00:23 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea80ef3-e0c2-4384-8164-699be99d9287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Volume volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 (d2b60006-d4f7-4b6e-a5a8-45788b5a5df2): created successfully Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea80ef3-e0c2-4384-8164-699be99d9287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (02bab118-1c4c-4794-9d92-b0350b2f2760) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0672c77e-8088-4732-aeed-6ecaaf4e2c76 tempest-VolumesTestJSON-1424261006 None] Created volume successfully. Sep 07 17:00:23 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 2147483648" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:23 devstack sudo[93600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 Sep 07 17:00:23 devstack sudo[93600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:24 devstack sudo[93600]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8158424-c94d-4897-8cbb-b4d5b3212783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b514f6d-dbf5-4078-81b2-48d0148420b8', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ee233-de78-40e0-b2c9-b79416bdc900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Volume volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 (7b514f6d-dbf5-4078-81b2-48d0148420b8): created successfully Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914ee233-de78-40e0-b2c9-b79416bdc900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Flow 'volume_create_manager' (07f70b05-ea39-4965-ad88-772d12f35150) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-14fa8d8a-616d-41d2-80f0-ce475a998add tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Created volume successfully. Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (d1b4b562-e17a-4085-8780-c1cb71109532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14eeca0-f7f4-44d7-a11b-138ad79ed411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b14eeca0-f7f4-44d7-a11b-138ad79ed411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1563250968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1eca2f-dcc9-4d1c-86f8-808f15ab153b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:25Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346822f-69d5-41d5-9050-80c4e7dcf4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d346822f-69d5-41d5-9050-80c4e7dcf4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0710fcf-89ab-48a6-9c60-b241454d1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0710fcf-89ab-48a6-9c60-b241454d1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc1eca2f-dcc9-4d1c-86f8-808f15ab153b', 'volume_name': 'volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27280c58-4e0a-480d-bfc3-5add2d9abe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27280c58-4e0a-480d-bfc3-5add2d9abe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acf7fb4-0f1c-4cca-bb04-55daa688307e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Volume bc1eca2f-dcc9-4d1c-86f8-808f15ab153b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b', 'volume_size': 1} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1563250968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc1eca2f-dcc9-4d1c-86f8-808f15ab153b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2f0d13109cc84675a0c3d5a7f35b4cd5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:25Z,use_quota=True,user_id='bb15e541329042ba9e9c8f1d21bf079c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Creating volume bc1eca2f-dcc9-4d1c-86f8-808f15ab153b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:24 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b 1073741824 Sep 07 17:00:24 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:25 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b 1073741824" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:25 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b Sep 07 17:00:25 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:25 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] <== create_volume: return (822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.628s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Creating offline snapshot a56e7c94-1b00-4169-839c-f3572d62897e of volume 7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5acf7fb4-0f1c-4cca-bb04-55daa688307e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda5553-eb1f-4205-9ab5-f48562dfd1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad8c6f1-51ec-4d4d-a533-5b9055dd9e19]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Volume volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b (bc1eca2f-dcc9-4d1c-86f8-808f15ab153b): created successfully Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efda5553-eb1f-4205-9ab5-f48562dfd1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Flow 'volume_create_manager' (d1b4b562-e17a-4085-8780-c1cb71109532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e454b0a6-1b1c-4afb-961e-6dc2ef5b78ca tempest-VolumesTestJSON-1424261006 None] Created volume successfully. Sep 07 17:00:25 devstack sudo[93616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 Sep 07 17:00:25 devstack sudo[93616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:26 devstack sudo[93616]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:26 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e 2G Sep 07 17:00:26 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Flow 'volume_create_manager' (949e96b7-24e6-4a86-9c03-9db856e90b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc85b4e-f50d-49e4-8807-750dce373bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0cc85b4e-f50d-49e4-8807-750dce373bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-954627130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3fd48f-8c65-4848-b587-d815d7886eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bdc036378b44cd9714778c493df1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:27Z,use_quota=True,user_id='8fc2a81e4f0e49b798fc1b2101ac05cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0764057d-a33b-4973-82f3-bb5104e4e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0764057d-a33b-4973-82f3-bb5104e4e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c36c12-f94a-419c-842e-8b1192121505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c36c12-f94a-419c-842e-8b1192121505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a3fd48f-8c65-4848-b587-d815d7886eb8', 'volume_name': 'volume-4a3fd48f-8c65-4848-b587-d815d7886eb8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58dc842-51b2-4b7e-bf8c-98e282f7d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c58dc842-51b2-4b7e-bf8c-98e282f7d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10b0389-2802-4548-ad3c-a5b4b96e991e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Volume 4a3fd48f-8c65-4848-b587-d815d7886eb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a3fd48f-8c65-4848-b587-d815d7886eb8', 'volume_size': 1} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:26 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e 2G" returned: 0 in 0.563s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:26 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e Sep 07 17:00:26 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:27 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:27 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e is being set with open permissions: ugo+rw Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:27 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e Sep 07 17:00:27 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:27 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:27 devstack sudo[93654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info Sep 07 17:00:27 devstack sudo[93654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:27 devstack sudo[93654]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:27 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info is being set with open permissions: ugo+rw Sep 07 17:00:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:27 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info Sep 07 17:00:27 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:28 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.info" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.499s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-954627130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a3fd48f-8c65-4848-b587-d815d7886eb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87bdc036378b44cd9714778c493df1ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:27Z,use_quota=True,user_id='8fc2a81e4f0e49b798fc1b2101ac05cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Creating volume 4a3fd48f-8c65-4848-b587-d815d7886eb8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:28 devstack sudo[93662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 1073741824 Sep 07 17:00:28 devstack sudo[93662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-73ba6d6c-90d4-4897-a13a-1c27012558ad tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Create snapshot completed successfully Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "cinder-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-quobyte-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6435039c-e749-4245-8b9b-6e0c1c42950e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:28 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b Sep 07 17:00:28 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:28 devstack sudo[93662]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 1073741824" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:28 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 Sep 07 17:00:28 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:28 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:28 devstack sudo[93675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b Sep 07 17:00:28 devstack sudo[93675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:29 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f10b0389-2802-4548-ad3c-a5b4b96e991e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a3fd48f-8c65-4848-b587-d815d7886eb8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e81f8-2a96-45dd-abbc-fa7df9ff31de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Volume volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 (4a3fd48f-8c65-4848-b587-d815d7886eb8): created successfully Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a2e81f8-2a96-45dd-abbc-fa7df9ff31de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Flow 'volume_create_manager' (949e96b7-24e6-4a86-9c03-9db856e90b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:29 devstack sudo[93675]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cd20fb7a-8293-4729-b4fb-13b2e749fb0a tempest-AttachVolumeShelveTestJSON-1785665822 None] Created volume successfully. Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b" released by "delete_volume" :: held 0.795s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Created reservations ['137539f4-744e-4195-8afc-52940f231ea6', '7d58a13e-7ca8-4d93-8a4d-c0c32dabfc9a', 'b537e5de-e816-4065-9db4-67ee80e76678', 'b9043729-728b-4c65-9a6e-f3da0a1b4bec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:29 devstack sudo[93680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:29 devstack sudo[93680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "cinder-a56e7c94-1b00-4169-839c-f3572d62897e-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-a56e7c94-1b00-4169-839c-f3572d62897e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "cinder-quobyte-a56e7c94-1b00-4169-839c-f3572d62897e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-a56e7c94-1b00-4169-839c-f3572d62897e" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Deleting offline snapshot a56e7c94-1b00-4169-839c-f3572d62897e of volume 7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] snapshot_file for this snap is: volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a0bcc1-60c4-4171-9b18-2825460ad7b0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:29 devstack sudo[93680]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-quobyte-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Deleted volume successfully. Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" acquired by "delete_volume" :: waited 0.054s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[500bcbf4-1c2f-4fe1-a265-548520329224]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac5dce30-13f2-4c7e-8db7-2e42df49bcab tempest-VolumesTestJSON-1424261006 None] Lock "cinder-bc1eca2f-dcc9-4d1c-86f8-808f15ab153b-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:29 devstack sudo[93683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e Sep 07 17:00:29 devstack sudo[93683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:30 devstack sudo[93689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 Sep 07 17:00:30 devstack sudo[93689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:30 devstack sudo[93683]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e" returned: 0 in 0.810s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b514f6d-dbf5-4078-81b2-48d0148420b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf50fea-1cea-40d8-9177-d4ccf414a6ea]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:30 devstack sudo[93689]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" returned: 0 in 0.983s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:30 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2 Sep 07 17:00:30 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:30 devstack sudo[93748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 Sep 07 17:00:30 devstack sudo[93748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:31 devstack sudo[93748]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8" returned: 0 in 0.749s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:31 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" returned: 0 in 0.566s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:31 devstack sudo[93772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2" released by "delete_volume" :: held 1.620s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:31 devstack sudo[93772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Created reservations ['14647f89-9b9e-45cf-8ce5-673a21f449d1', '969dffac-a2c1-4b1c-8b5d-9edae41d982b', '4e562ef8-380f-484c-a857-19992a566820', '540d9bf6-5350-4769-9b57-49eeaf8f9505'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:31 devstack sudo[93810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:31 devstack sudo[93810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-48279807-0336-441d-9a0b-169b81fba271-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-48279807-0336-441d-9a0b-169b81fba271-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:32 devstack sudo[93810]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.536s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Deleted volume successfully. Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "cinder-quobyte-48279807-0336-441d-9a0b-169b81fba271" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:32 devstack sudo[93772]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e" returned: 0 in 0.931s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10725ef8-392d-4d23-8f43-ab2e12431522 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-d2b60006-d4f7-4b6e-a5a8-45788b5a5df2-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-48279807-0336-441d-9a0b-169b81fba271" acquired by "delete_volume" :: waited 0.074s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:32 devstack sudo[93816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e Sep 07 17:00:32 devstack sudo[93816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[086d9b31-18a9-437b-a6d8-eef1adf3644d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:32 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 Sep 07 17:00:32 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:32 devstack sudo[93816]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8.a56e7c94-1b00-4169-839c-f3572d62897e" returned: 0 in 0.582s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-a56e7c94-1b00-4169-839c-f3572d62897e" released by "_delete_snapshot" :: held 3.279s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" released by "delete_snapshot" :: held 3.347s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Created reservations ['d00ce169-91b8-4205-8c04-ce9a97739d42', '3c7c9454-2231-4471-a8b5-23b10e40e332', '7b1532bd-9e5f-4e55-98ed-60b476710507', '49beb2a0-6a4c-4fce-ad66-7d037d316352'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:33 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271" returned: 0 in 0.784s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:33 devstack sudo[93831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271 Sep 07 17:00:33 devstack sudo[93831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Delete snapshot completed successfully. Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2ab1bba7-ce80-4d0d-8408-8fa709c14cb8 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-a56e7c94-1b00-4169-839c-f3572d62897e-delete_snapshot" released by "delete_snapshot" :: held 3.696s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:33 devstack sudo[93831]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-48279807-0336-441d-9a0b-169b81fba271" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-quobyte-48279807-0336-441d-9a0b-169b81fba271" released by "delete_volume" :: held 1.255s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Created reservations ['3f95e179-ecbe-4980-9a38-7202d67dbde9', '13bb2b48-a46c-4670-b82a-17d64305a52e', '5ac3f24b-e159-4975-858f-68fde231799a', '2e87464a-b293-4c6f-ae39-006c09b453c6'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:33 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:33 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "cinder-7b514f6d-dbf5-4078-81b2-48d0148420b8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-7b514f6d-dbf5-4078-81b2-48d0148420b8-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:34 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Deleted volume successfully. Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-db1671ad-ee44-4b5d-95fb-5b21e255d4d8 tempest-VolumesTestJSON-1424261006 None] Lock "cinder-48279807-0336-441d-9a0b-169b81fba271-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2e9725-5132-4071-ac79-36a7a9338778]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:34 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 Sep 07 17:00:34 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:35 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8" returned: 0 in 0.804s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:35 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8 Sep 07 17:00:35 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:35 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b514f6d-dbf5-4078-81b2-48d0148420b8" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-quobyte-7b514f6d-dbf5-4078-81b2-48d0148420b8" released by "delete_volume" :: held 1.340s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Created reservations ['f27806b9-4679-48dd-9d39-2007c0217ba1', 'd34437cb-1e55-4ae9-a07d-1acd17d7b88e', 'ce0df213-77cb-4908-806b-74e635c3602c', '043bb5af-c9ec-4ba8-bec5-78d95fdb0685'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:35 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:00:35 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:36 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.657s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:00:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Deleted volume successfully. Sep 07 17:00:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d1e2a9d-4eb6-4d5b-b082-a4f5dec0fe16 tempest-VolumesSnapshotNegativeTestJSON-28583306 None] Lock "cinder-7b514f6d-dbf5-4078-81b2-48d0148420b8-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ef8663f4-73ff-4834-a694-541cd12e51b1 tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-964596038: creating Sep 07 17:00:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=84,cinder:UPDATE=84,cinder:INSERT=22,cinder:DELETE=12 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:00:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ef8663f4-73ff-4834-a694-541cd12e51b1 tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-964596038: created successfully Sep 07 17:00:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ef8663f4-73ff-4834-a694-541cd12e51b1 tempest-GroupSnapshotsTest-1520013021 None] Create group completed successfully. Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (4dbe78fe-32d8-483b-aafe-2399559e1933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864114a-791e-4ece-9e62-48335322ad18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1864114a-791e-4ece-9e62-48335322ad18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-869455052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=724aa452-679f-405f-9e75-cf54b9ada86d,host='devstack@QuobyteHD#QuobyteHD',id=b6317b75-dc5c-46d5-b082-0d468b20a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:43Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2936d54a-f89d-43cf-9891-cbfc043bedfb),volume_type_id=2936d54a-f89d-43cf-9891-cbfc043bedfb)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0567dac-c21d-4a68-a720-894668b2f545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0567dac-c21d-4a68-a720-894668b2f545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c3b38b-7e6d-4c4d-b11d-ccf2bcff2935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32c3b38b-7e6d-4c4d-b11d-ccf2bcff2935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6317b75-dc5c-46d5-b082-0d468b20a8b9', 'volume_name': 'volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ce501a-252f-4e50-ba5e-c11f215bbad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00ce501a-252f-4e50-ba5e-c11f215bbad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123415f2-bada-4b18-bf36-388129acffa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Volume b6317b75-dc5c-46d5-b082-0d468b20a8b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9', 'volume_size': 1} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=724aa452-679f-405f-9e75-cf54b9ada86d,created_at=2026-09-07T15:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-869455052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=724aa452-679f-405f-9e75-cf54b9ada86d,host='devstack@QuobyteHD#QuobyteHD',id=b6317b75-dc5c-46d5-b082-0d468b20a8b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:43Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2936d54a-f89d-43cf-9891-cbfc043bedfb),volume_type_id=2936d54a-f89d-43cf-9891-cbfc043bedfb)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Creating volume b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:43 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:43 devstack sudo[93880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 1073741824 Sep 07 17:00:43 devstack sudo[93880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:44 devstack sudo[93880]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 1073741824" returned: 0 in 0.643s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:44 devstack sudo[93912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:00:44 devstack sudo[93912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:44 devstack sudo[93912]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123415f2-bada-4b18-bf36-388129acffa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae17e759-6fb4-42c6-9743-183bcda78118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Volume volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 (b6317b75-dc5c-46d5-b082-0d468b20a8b9): created successfully Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae17e759-6fb4-42c6-9743-183bcda78118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (4dbe78fe-32d8-483b-aafe-2399559e1933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-992ea19c-30f9-421f-a84d-25a3ff4565e4 tempest-GroupSnapshotsTest-1520013021 None] Created volume successfully. Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-798d5460-2eb2-4df8-97ba-538c7c35386f req-4b96ac36-4972-44a3-85f8-516144a1c89c tempest-AttachVolumeShelveTestJSON-1785665822 None] No connector for attachment 69fe65bc-8b53-4734-bd44-dbbdc4d0f320; skipping storage backend terminate_connection call. {{(pid=86783) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 17:00:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-798d5460-2eb2-4df8-97ba-538c7c35386f req-4b96ac36-4972-44a3-85f8-516144a1c89c tempest-AttachVolumeShelveTestJSON-1785665822 None] Deleting attachment 69fe65bc-8b53-4734-bd44-dbbdc4d0f320. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:00:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] GroupSnapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: creating. Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Group snapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Creating offline snapshot b01fc2ff-53e9-4a7b-8428-8bb4dd864832 of volume b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc77a507-4a7e-40a5-be81-381ff0f35ddc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:46 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:00:46 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:46 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.445s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:46 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 1G Sep 07 17:00:46 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:47 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 1G" returned: 0 in 0.601s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:47 devstack sudo[93930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:00:47 devstack sudo[93930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:47 devstack sudo[93930]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:47 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:47 devstack sudo[93936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:00:47 devstack sudo[93936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:47 devstack sudo[93936]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:48 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info Sep 07 17:00:48 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:48 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:48 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:48 devstack sudo[93943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info Sep 07 17:00:48 devstack sudo[93943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:48 devstack sudo[93943]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.info" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c87c3a4e-a61a-4fab-ab70-89f6b33fec18 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: created successfully Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Creating volume e490e3dc-e0c7-4515-a40c-65ba8ab6e033 from snapshot b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] snapshot: b01fc2ff-53e9-4a7b-8428-8bb4dd864832, volume: e490e3dc-e0c7-4515-a40c-65ba8ab6e033, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6e342-dab2-4384-a740-5681229015fe]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:51 devstack sudo[93952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:00:51 devstack sudo[93952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:51 devstack sudo[93952]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.717s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:00:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400ea5b-b73d-4d94-b955-d56f29c6d9a9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:00:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:51 devstack sudo[93965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:00:51 devstack sudo[93965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:52 devstack sudo[93965]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:00:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:00:52 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:00:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:52 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 Sep 07 17:00:52 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (56b343b7-0e9d-4614-96b3-e74d05d514a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b3f710-4783-4f0d-9a27-f04f700d79c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b3f710-4783-4f0d-9a27-f04f700d79c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1420567703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1937b68c-f0ed-4324-8b52-1ca40a81b4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:57Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b096cdb7-8725-4ae8-8862-a5150cab49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b096cdb7-8725-4ae8-8862-a5150cab49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbe7f4c-de88-4782-9ef7-ec016b642133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2bbe7f4c-de88-4782-9ef7-ec016b642133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1937b68c-f0ed-4324-8b52-1ca40a81b4d9', 'volume_name': 'volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23dbc0-7e64-4d5e-bc3b-9314dcb3db4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f23dbc0-7e64-4d5e-bc3b-9314dcb3db4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863a188c-1cdb-49b5-b41c-8c08c916805a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:00:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Volume 1937b68c-f0ed-4324-8b52-1ca40a81b4d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9', 'volume_size': 1} Sep 07 17:00:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" returned: 0 in 6.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9, size 1024.00 MB, duration 6.24 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:00:58 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Converted 1024.00 MB image at 164.04 MB/s Sep 07 17:00:58 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:58 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 Sep 07 17:00:58 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:58 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" released by "_copy_volume_from_snapshot" :: held 7.986s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" released by "_create_volume_from_snapshot" :: held 8.104s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.128s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.061s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1420567703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1937b68c-f0ed-4324-8b52-1ca40a81b4d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d10fa9c5eb0549ab814bf6127e090c24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:00:57Z,use_quota=True,user_id='3eaac109a5284474bf2ee1e6d6b7e8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Creating volume 1937b68c-f0ed-4324-8b52-1ca40a81b4d9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:00:58 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:00:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:00:58 devstack sudo[94086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 1073741824 Sep 07 17:00:58 devstack sudo[94086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:00:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1ba14f20-c89b-425e-b22f-dbe8a996d0a8 tempest-GroupSnapshotsTest-1520013021 None] Create group from source-snapshot-474b152e-e6bd-47e1-bc4c-45f2ef6c0808 completed successfully. Sep 07 17:00:59 devstack sudo[94086]: pam_unix(sudo:session): session closed for user root Sep 07 17:00:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 1073741824" returned: 0 in 1.015s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:00:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:00 devstack sudo[94094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 Sep 07 17:01:00 devstack sudo[94094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:00 devstack sudo[94094]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (863a188c-1cdb-49b5-b41c-8c08c916805a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27294c3-4574-4818-aa17-2e3b627895a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=81,cinder:UPDATE=97,cinder:DELETE=4,cinder:INSERT=20 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:01:00 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Volume volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 (1937b68c-f0ed-4324-8b52-1ca40a81b4d9): created successfully Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e27294c3-4574-4818-aa17-2e3b627895a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Flow 'volume_create_manager' (56b343b7-0e9d-4614-96b3-e74d05d514a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3accd893-dbf5-443e-89a0-e7656651e967 tempest-AttachVolumeNegativeTest-704001503 None] Created volume successfully. Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3dd8b1-1011-449f-9004-0785750a050f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[94097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 Sep 07 17:01:01 devstack sudo[94097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:01 devstack sudo[94097]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" returned: 0 in 0.584s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:01 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033 Sep 07 17:01:01 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-e490e3dc-e0c7-4515-a40c-65ba8ab6e033" released by "delete_volume" :: held 1.021s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['8629167c-65f7-4dc8-a808-2120f9318e32'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1324861515 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1324861515, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1324861515 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1324861515, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['e2e2a0e7-2501-4d7b-a7af-1ba435213372', 'c075c244-85f2-446a-9905-dbd903d7bc20', '79b46480-ae2e-4bc4-b64b-2aaeacb8090e', '7664e8b2-4339-4fdd-9ca0-8e68da56e53e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:02 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: deleting Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:02 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Deleting offline snapshot b01fc2ff-53e9-4a7b-8428-8bb4dd864832 of volume b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] snapshot_file for this snap is: volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.510s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc138243-5608-4d8b-860e-f6f699f7a527]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c860e857-3122-4e14-b16f-a5b59592f7ec tempest-GroupSnapshotsTest-1520013021 None] Delete group completed successfully. Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38f88226-038e-4c4c-af4c-07bfd94a5056 req-981fafb3-2e2b-417c-a21e-bb1022cc2a2c tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38f88226-038e-4c4c-af4c-07bfd94a5056 req-981fafb3-2e2b-417c-a21e-bb1022cc2a2c tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-38f88226-038e-4c4c-af4c-07bfd94a5056 req-981fafb3-2e2b-417c-a21e-bb1022cc2a2c tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-38f88226-038e-4c4c-af4c-07bfd94a5056 req-981fafb3-2e2b-417c-a21e-bb1022cc2a2c tempest-AttachVolumeNegativeTest-704001503 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8650d9b9-2086-4fe8-a2ef-167a510619e7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:01:03 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:01:03 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-38f88226-038e-4c4c-af4c-07bfd94a5056 req-981fafb3-2e2b-417c-a21e-bb1022cc2a2c tempest-AttachVolumeNegativeTest-704001503 None] attachment_update completed successfully. Sep 07 17:01:03 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3633ff6-a99f-40f3-bfc6-ececfff9096c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:03 devstack sudo[94408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:01:03 devstack sudo[94408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:04 devstack sudo[94408]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.749s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:04 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:01:04 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:04 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:04 devstack sudo[94524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832 Sep 07 17:01:04 devstack sudo[94524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:05 devstack sudo[94524]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9.b01fc2ff-53e9-4a7b-8428-8bb4dd864832" returned: 0 in 0.496s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b01fc2ff-53e9-4a7b-8428-8bb4dd864832" released by "_delete_snapshot" :: held 2.484s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" released by "delete_snapshot" :: held 2.541s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:05 devstack cinder-volume[86783]: WARNING cinder.quota [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1324861515 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1324861515, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:05 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['dcd390b6-c821-49cb-960e-00b4984390cc', '3c578d8a-f5d7-4dcb-8290-1e71f3a0c5fc', 'cbb03601-5270-4414-8f4d-bbec942ab7d5', '30415c04-f07e-44c8-a07e-f9f5ada9bc69'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-10a0edf0-1f1b-4316-ad98-9a961a52a57b tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 474b152e-e6bd-47e1-bc4c-45f2ef6c0808: deleted successfully Sep 07 17:01:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-e589f15a-47c7-4f0e-84b8-3acb75a5a75e req-3849625f-a4a6-4e62-a1ec-3202a793af29 tempest-AttachVolumeNegativeTest-704001503 None] Terminate volume connection completed successfully. Sep 07 17:01:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-e589f15a-47c7-4f0e-84b8-3acb75a5a75e req-3849625f-a4a6-4e62-a1ec-3202a793af29 tempest-AttachVolumeNegativeTest-704001503 None] Deleting attachment 8650d9b9-2086-4fe8-a2ef-167a510619e7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:01:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" acquired by "delete_volume" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc71d5c1-8670-4c2c-b3d7-df296275a1ba]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:07 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:01:07 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:07 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.596s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:07 devstack sudo[94565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9 Sep 07 17:01:07 devstack sudo[94565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:07 devstack sudo[94565]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b6317b75-dc5c-46d5-b082-0d468b20a8b9" returned: 0 in 0.472s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-b6317b75-dc5c-46d5-b082-0d468b20a8b9" released by "delete_volume" :: held 1.219s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['4c8ea1e6-e3e0-4263-91a0-4eb9ce06271c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:08 devstack cinder-volume[86783]: WARNING cinder.db.api [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1324861515'] Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['a951f47f-8b7f-4c99-a2d0-3aac01908c62', '02781d5c-c7a1-4912-afbb-41d0e5bdc152', 'de99cac2-0310-4825-949c-646643570c71', '3836b5db-1381-4590-a9c1-dfca1864923c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:08 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:08 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:08 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.436s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d033389b-69e1-414d-92f4-7daeb4fde9e8 tempest-GroupSnapshotsTest-1520013021 None] Delete group completed successfully. Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:09 devstack sudo[94589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:09 devstack sudo[94589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-820b6c6a-b001-45b6-96fc-6225cf2a082d tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-768722191: creating Sep 07 17:01:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-820b6c6a-b001-45b6-96fc-6225cf2a082d tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-768722191: created successfully Sep 07 17:01:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-820b6c6a-b001-45b6-96fc-6225cf2a082d tempest-GroupSnapshotsTest-1520013021 None] Create group completed successfully. Sep 07 17:01:10 devstack sudo[94589]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.564s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:01:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:01:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (0e842421-bc48-4bfc-aff5-cf03dca88911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90c1fdf-8d3a-4ec1-bb8d-4956845e3098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90c1fdf-8d3a-4ec1-bb8d-4956845e3098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283194334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3348c1af-1d51-4fa1-8240-f021a1b85569,host='devstack@QuobyteHD#QuobyteHD',id=fe8b57ef-b371-47e1-b707-97141e5f7195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def93851-0ac9-441b-8b31-298161969ff7),volume_type_id=def93851-0ac9-441b-8b31-298161969ff7)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4000a-5707-4f6b-9a5c-646e20741a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e4000a-5707-4f6b-9a5c-646e20741a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21069daf-0090-4e85-aa7c-68959036b084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21069daf-0090-4e85-aa7c-68959036b084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8b57ef-b371-47e1-b707-97141e5f7195', 'volume_name': 'volume-fe8b57ef-b371-47e1-b707-97141e5f7195', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5dbf7e-f9c6-4bfc-84f1-3f9e9f202cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5dbf7e-f9c6-4bfc-84f1-3f9e9f202cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53df75c2-55d6-4389-a2ab-e204e1693c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Volume fe8b57ef-b371-47e1-b707-97141e5f7195: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8b57ef-b371-47e1-b707-97141e5f7195', 'volume_size': 1} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3348c1af-1d51-4fa1-8240-f021a1b85569,created_at=2026-09-07T15:01:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-283194334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3348c1af-1d51-4fa1-8240-f021a1b85569,host='devstack@QuobyteHD#QuobyteHD',id=fe8b57ef-b371-47e1-b707-97141e5f7195,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:12Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def93851-0ac9-441b-8b31-298161969ff7),volume_type_id=def93851-0ac9-441b-8b31-298161969ff7)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Creating volume fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:12 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:12 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 1073741824 Sep 07 17:01:12 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:13 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 1073741824" returned: 0 in 0.604s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:13 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 Sep 07 17:01:13 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:13 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53df75c2-55d6-4389-a2ab-e204e1693c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8b57ef-b371-47e1-b707-97141e5f7195', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1637752f-effb-4163-8821-6b50ef5c17e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:13 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Volume volume-fe8b57ef-b371-47e1-b707-97141e5f7195 (fe8b57ef-b371-47e1-b707-97141e5f7195): created successfully Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1637752f-effb-4163-8821-6b50ef5c17e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (0e842421-bc48-4bfc-aff5-cf03dca88911) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4b6bdf58-dcc5-463e-b327-ff131931a3af tempest-GroupSnapshotsTest-1520013021 None] Created volume successfully. Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-1937b68c-f0ed-4324-8b52-1ca40a81b4d9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-1937b68c-f0ed-4324-8b52-1ca40a81b4d9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-quobyte-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[11561125-da07-4316-838e-b1fd7aca150b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack sudo[94608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 Sep 07 17:01:14 devstack sudo[94608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack sudo[94608]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:14 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9 Sep 07 17:01:14 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:14 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-1937b68c-f0ed-4324-8b52-1ca40a81b4d9" released by "delete_volume" :: held 0.688s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Created reservations ['d48d2b42-bd16-4ca0-8154-84e8f85ee64d', '698f99d3-0f09-45b8-ad96-96854792518b', '2520a54e-5edb-4b61-b8f6-a4a8bf7408a0', '73bdb99e-5f38-4470-be81-880bfa2fbcc3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[94616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:15 devstack sudo[94616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Flow 'volume_create_manager' (190dcb79-f0ae-4d67-bc66-1f8dcc9b6ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb706c-9e45-42b4-acfa-76a8a2b2d7a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5feb706c-9e45-42b4-acfa-76a8a2b2d7a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1023355587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e988ad6d-ba4f-4510-8816-fca116d8a470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29409616c4314ed1931523d9bfe79fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:15Z,use_quota=True,user_id='6923fe178a104203aacd97b4fc4d01ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff24cd8-31bf-4a66-8422-570b128a276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ff24cd8-31bf-4a66-8422-570b128a276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99acbde-4b4f-41ea-b1be-09d7dddd3584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c99acbde-4b4f-41ea-b1be-09d7dddd3584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e988ad6d-ba4f-4510-8816-fca116d8a470', 'volume_name': 'volume-e988ad6d-ba4f-4510-8816-fca116d8a470', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c6f1f1-e195-4a78-9104-16433f3a2bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c6f1f1-e195-4a78-9104-16433f3a2bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68818e7b-5fe2-4d80-8195-2e3b6a8d9dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume e988ad6d-ba4f-4510-8816-fca116d8a470: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e988ad6d-ba4f-4510-8816-fca116d8a470', 'volume_size': 1} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1023355587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e988ad6d-ba4f-4510-8816-fca116d8a470,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29409616c4314ed1931523d9bfe79fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:15Z,use_quota=True,user_id='6923fe178a104203aacd97b4fc4d01ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Creating volume e988ad6d-ba4f-4510-8816-fca116d8a470 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:15 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:15 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 1073741824 Sep 07 17:01:15 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:15 devstack sudo[94616]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Deleted volume successfully. Sep 07 17:01:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08c7871-3074-439f-ba8f-ad0899dff137 tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-1937b68c-f0ed-4324-8b52-1ca40a81b4d9-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-90cc4b96-ce46-4097-a735-acaf5e1f722b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-90cc4b96-ce46-4097-a735-acaf5e1f722b-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-quobyte-90cc4b96-ce46-4097-a735-acaf5e1f722b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-90cc4b96-ce46-4097-a735-acaf5e1f722b" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e4fdbc-6771-4f7d-9c8d-0199f2115ed1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 1073741824" returned: 0 in 0.882s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack sudo[94634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b Sep 07 17:01:16 devstack sudo[94634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[94637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 Sep 07 17:01:16 devstack sudo[94637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Flow 'volume_create_manager' (d7630f34-ba1b-4b0d-a927-ce0a869b9d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32023aa-1e04-4d19-bbbb-adf4a40175be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (f2d67a96-71f8-4179-aa8a-dae447605b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eceafd0-6aab-43b7-84e3-555489a84d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32023aa-1e04-4d19-bbbb-adf4a40175be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-50133516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56db29-c38f-473d-8879-e06be5631986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29409616c4314ed1931523d9bfe79fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:16Z,use_quota=True,user_id='6923fe178a104203aacd97b4fc4d01ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e057685-1dd3-451f-805f-2a41a15e91de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e057685-1dd3-451f-805f-2a41a15e91de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61156852-a898-4e46-bcd9-d244e3d6abd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61156852-a898-4e46-bcd9-d244e3d6abd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a56db29-c38f-473d-8879-e06be5631986', 'volume_name': 'volume-5a56db29-c38f-473d-8879-e06be5631986', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3596895a-b437-437f-81a2-8af652383ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3596895a-b437-437f-81a2-8af652383ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b0e18-338b-4054-8550-925b4ac90d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume 5a56db29-c38f-473d-8879-e06be5631986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a56db29-c38f-473d-8879-e06be5631986', 'volume_size': 1} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eceafd0-6aab-43b7-84e3-555489a84d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-867936271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3348c1af-1d51-4fa1-8240-f021a1b85569,host='devstack@QuobyteHD#QuobyteHD',id=c01b604c-8717-4565-8eca-ccae4b2862f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:16Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def93851-0ac9-441b-8b31-298161969ff7),volume_type_id=def93851-0ac9-441b-8b31-298161969ff7)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a401fb41-25d7-4750-be44-c72106a066b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a401fb41-25d7-4750-be44-c72106a066b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e2950d-0149-4578-9bd6-f20837c39c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89e2950d-0149-4578-9bd6-f20837c39c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01b604c-8717-4565-8eca-ccae4b2862f7', 'volume_name': 'volume-c01b604c-8717-4565-8eca-ccae4b2862f7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d86276-6a09-4df5-aef1-b0876d9a4df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d86276-6a09-4df5-aef1-b0876d9a4df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack sudo[94634]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ddfdbe-7809-49e8-a001-917f10170827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Volume c01b604c-8717-4565-8eca-ccae4b2862f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01b604c-8717-4565-8eca-ccae4b2862f7', 'volume_size': 1} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b" returned: 0 in 0.574s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack sudo[94637]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470" returned: 0 in 0.332s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.324s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-50133516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a56db29-c38f-473d-8879-e06be5631986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29409616c4314ed1931523d9bfe79fab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:16Z,use_quota=True,user_id='6923fe178a104203aacd97b4fc4d01ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Creating volume 5a56db29-c38f-473d-8879-e06be5631986 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:16 devstack sudo[94644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:16 devstack sudo[94644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68818e7b-5fe2-4d80-8195-2e3b6a8d9dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e988ad6d-ba4f-4510-8816-fca116d8a470', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b2bbe8-0047-4e5c-a072-73799fca37ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:16 devstack sudo[94646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 1073741824 Sep 07 17:01:16 devstack sudo[94646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume volume-e988ad6d-ba4f-4510-8816-fca116d8a470 (e988ad6d-ba4f-4510-8816-fca116d8a470): created successfully Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b2bbe8-0047-4e5c-a072-73799fca37ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Flow 'volume_create_manager' (190dcb79-f0ae-4d67-bc66-1f8dcc9b6ca1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7c76ce04-f2e8-4312-8195-c0f3145cbe0b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Created volume successfully. Sep 07 17:01:17 devstack sudo[94644]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-90cc4b96-ce46-4097-a735-acaf5e1f722b" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-90cc4b96-ce46-4097-a735-acaf5e1f722b" released by "delete_volume" :: held 0.924s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Created reservations ['15c29807-f854-4032-a040-9cd42a260865', '0ed7c9a5-c875-4026-9ada-fc804f466d8d', '288f33ad-1a2d-4ded-b0b6-a076e2e4ee18', 'df854353-7824-4873-8982-efd378db8a14'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[94653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:17 devstack sudo[94653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[94646]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 1073741824" returned: 0 in 0.601s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[94656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 Sep 07 17:01:17 devstack sudo[94656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack sudo[94653]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Deleted volume successfully. Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-08537e51-fd91-458a-bbc8-060f8f625bed-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-08537e51-fd91-458a-bbc8-060f8f625bed-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-31b24a92-d63d-4e34-a13e-209abb3d5dfc tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-90cc4b96-ce46-4097-a735-acaf5e1f722b-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "cinder-quobyte-08537e51-fd91-458a-bbc8-060f8f625bed" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-08537e51-fd91-458a-bbc8-060f8f625bed" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[80df4d80-29af-4c46-91aa-3ac64e9885b2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack sudo[94656]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.072s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3348c1af-1d51-4fa1-8240-f021a1b85569,created_at=2026-09-07T15:01:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-867936271',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3348c1af-1d51-4fa1-8240-f021a1b85569,host='devstack@QuobyteHD#QuobyteHD',id=c01b604c-8717-4565-8eca-ccae4b2862f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:16Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(def93851-0ac9-441b-8b31-298161969ff7),volume_type_id=def93851-0ac9-441b-8b31-298161969ff7)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Creating volume c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:17 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f0b0e18-338b-4054-8550-925b4ac90d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a56db29-c38f-473d-8879-e06be5631986', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:17 devstack sudo[94660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 1073741824 Sep 07 17:01:17 devstack sudo[94660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355c265b-56a5-479e-aa04-895168a7fc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:17 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed Sep 07 17:01:17 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Volume volume-5a56db29-c38f-473d-8879-e06be5631986 (5a56db29-c38f-473d-8879-e06be5631986): created successfully Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355c265b-56a5-479e-aa04-895168a7fc15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Flow 'volume_create_manager' (d7630f34-ba1b-4b0d-a927-ce0a869b9d7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-067a54a0-0b3c-4d81-b6c6-25da8bab592b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Created volume successfully. Sep 07 17:01:18 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed Sep 07 17:01:18 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[94660]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 1073741824" returned: 0 in 0.554s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[94672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 Sep 07 17:01:18 devstack sudo[94672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-08537e51-fd91-458a-bbc8-060f8f625bed" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-quobyte-08537e51-fd91-458a-bbc8-060f8f625bed" released by "delete_volume" :: held 0.817s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Created reservations ['264ad77d-9d9b-4953-9839-c9f1cc7f412c', '33742b72-af57-45a3-b486-7220100bc34e', '00549a5b-d83a-4d13-bb34-0aae0c332bb2', 'c878a429-98bb-4f7c-bebb-8c40437417cf'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:18 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:18 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:18 devstack sudo[94672]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09ddfdbe-7809-49e8-a001-917f10170827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01b604c-8717-4565-8eca-ccae4b2862f7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f020cf1f-7246-47c8-bad0-b22ea43a969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Volume volume-c01b604c-8717-4565-8eca-ccae4b2862f7 (c01b604c-8717-4565-8eca-ccae4b2862f7): created successfully Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f020cf1f-7246-47c8-bad0-b22ea43a969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (f2d67a96-71f8-4179-aa8a-dae447605b69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-003cc173-3580-4ec6-a45c-9371f73e08d6 tempest-GroupSnapshotsTest-1520013021 None] Created volume successfully. Sep 07 17:01:19 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:19 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Deleted volume successfully. Sep 07 17:01:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ce12eb2-2aa5-4eca-9bda-b613226cb1af tempest-AttachVolumeNegativeTest-704001503 None] Lock "cinder-08537e51-fd91-458a-bbc8-060f8f625bed-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f3a4c15d-cdee-4b96-9d7b-e0eb8956084a tempest-GroupSnapshotsTest-1520013021 None] Update group completed successfully. Sep 07 17:01:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-471edd54-694a-49b3-acc6-b2231dfe4929 tempest-GroupSnapshotsTest-1520013021 None] Update group completed successfully. Sep 07 17:01:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-179e0281-4d16-415f-8c92-cdb5465be87b tempest-GroupSnapshotsTest-1520013021 None] Update group completed successfully. Sep 07 17:01:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-678f78b3-c156-451f-ba20-aeeed2f3afac tempest-GroupSnapshotsTest-1520013021 None] Update group completed successfully. Sep 07 17:01:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] GroupSnapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: creating. Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Group snapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Creating offline snapshot 23fd36bc-80db-4b01-8a07-7781b1230737 of volume fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[30765856-27c3-48c8-afb1-f0beea658a25]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 Sep 07 17:01:26 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:26 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195" returned: 0 in 0.705s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:26 devstack sudo[94797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 1G Sep 07 17:01:26 devstack sudo[94797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:27 devstack sudo[94797]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 1G" returned: 0 in 0.790s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8b57ef-b371-47e1-b707-97141e5f7195 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:27 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8b57ef-b371-47e1-b707-97141e5f7195 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 Sep 07 17:01:27 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe8b57ef-b371-47e1-b707-97141e5f7195 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737" returned: 0 in 0.638s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[94815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 Sep 07 17:01:28 devstack sudo[94815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack sudo[94815]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[94818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info Sep 07 17:01:28 devstack sudo[94818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Acquiring lock "cinder-4a3fd48f-8c65-4848-b587-d815d7886eb8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "cinder-4a3fd48f-8c65-4848-b587-d815d7886eb8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Acquiring lock "cinder-quobyte-4a3fd48f-8c65-4848-b587-d815d7886eb8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "cinder-quobyte-4a3fd48f-8c65-4848-b587-d815d7886eb8" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae72b12-9a2e-4db0-9818-242a83e75ce0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[94818]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:28 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:28 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 Sep 07 17:01:28 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:28 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info Sep 07 17:01:28 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:29 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.info" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.439s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Creating offline snapshot f856b6c8-c286-43d2-a3e6-60649dc4ec2e of volume c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebd4cbf-cb34-4bfa-90bf-157d02e9421f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:29 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8" returned: 0 in 0.737s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:29 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8 Sep 07 17:01:29 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:29 devstack sudo[94828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 Sep 07 17:01:29 devstack sudo[94828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:29 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4a3fd48f-8c65-4848-b587-d815d7886eb8" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "cinder-quobyte-4a3fd48f-8c65-4848-b587-d815d7886eb8" released by "delete_volume" :: held 1.282s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Created reservations ['ef4a910d-e847-4021-abec-cc0a4aa41ce7', '4e4de0f8-bded-4817-9dae-f981deb5e253', '04030917-c973-43e5-a88a-476f8eb463b9', 'c8929cd2-3d38-4023-a245-88a44d8bc37f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:30 devstack sudo[94828]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7" returned: 0 in 0.783s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:30 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e 1G Sep 07 17:01:30 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:30 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:30 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:30 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Deleted volume successfully. Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9f928af0-75c6-4788-b290-a20306df6eb6 tempest-AttachVolumeShelveTestJSON-1785665822 None] Lock "cinder-4a3fd48f-8c65-4848-b587-d815d7886eb8-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:30 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e 1G" returned: 0 in 0.705s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01b604c-8717-4565-8eca-ccae4b2862f7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:30 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01b604c-8717-4565-8eca-ccae4b2862f7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e Sep 07 17:01:30 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:31 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01b604c-8717-4565-8eca-ccae4b2862f7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:31 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:31 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e Sep 07 17:01:31 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:31 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:31 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info Sep 07 17:01:31 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-500ca9ba-a200-42ee-b583-d36da60bafd5 tempest-BackendsCapabilitiesAdminTestsJSON-1076884856 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5174179077148, 'free_capacity_gb': 1773.5174179077148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 17:01:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68b7ce78-71c4-4603-8bec-d309aea74303 tempest-BackendsCapabilitiesAdminTestsJSON-1076884856 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5174179077148, 'free_capacity_gb': 1773.5174179077148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 17:01:32 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:32 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info Sep 07 17:01:32 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:32 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.info" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.290s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-21e51a11-d8cb-45a7-8f3c-3cde2c11e119 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: created successfully Sep 07 17:01:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: deleting Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-23fd36bc-80db-4b01-8a07-7781b1230737" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-23fd36bc-80db-4b01-8a07-7781b1230737" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Deleting offline snapshot 23fd36bc-80db-4b01-8a07-7781b1230737 of volume fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] snapshot_file for this snap is: volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b236c72-fb41-4daf-afa2-023487a50b16]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[94902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 Sep 07 17:01:34 devstack sudo[94902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:34 devstack sudo[94902]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe8b57ef-b371-47e1-b707-97141e5f7195(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e5f758-cd6c-4fb6-8e4d-3e60f3ef3060]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:34 devstack sudo[94907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 Sep 07 17:01:34 devstack sudo[94907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack sudo[94907]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195" returned: 0 in 0.614s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:35 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 Sep 07 17:01:35 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:35 devstack sudo[94918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737 Sep 07 17:01:35 devstack sudo[94918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:35 devstack sudo[94918]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195.23fd36bc-80db-4b01-8a07-7781b1230737" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-23fd36bc-80db-4b01-8a07-7781b1230737" released by "_delete_snapshot" :: held 1.944s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" released by "delete_snapshot" :: held 1.984s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-f856b6c8-c286-43d2-a3e6-60649dc4ec2e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-f856b6c8-c286-43d2-a3e6-60649dc4ec2e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Deleting offline snapshot f856b6c8-c286-43d2-a3e6-60649dc4ec2e of volume c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] snapshot_file for this snap is: volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6277b565-37fb-44c4-af5d-c78f1de4e475]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e Sep 07 17:01:36 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:36 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e" returned: 0 in 0.505s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01b604c-8717-4565-8eca-ccae4b2862f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc70383-2b1a-4793-be72-8998bc8f080e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:36 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 Sep 07 17:01:36 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7" returned: 0 in 0.609s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[94932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e Sep 07 17:01:37 devstack sudo[94932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:37 devstack sudo[94932]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:37 devstack sudo[94937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e Sep 07 17:01:37 devstack sudo[94937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:38 devstack sudo[94937]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7.f856b6c8-c286-43d2-a3e6-60649dc4ec2e" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-f856b6c8-c286-43d2-a3e6-60649dc4ec2e" released by "_delete_snapshot" :: held 2.089s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" released by "delete_snapshot" :: held 2.127s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:38 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-547265748 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-547265748, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:38 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-547265748 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-547265748, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['740319e5-2fb8-4f91-8596-50daeb16297d', 'a18837b6-d073-4e8a-9b52-4285f4223e84', 'a9ec7ae0-5d6b-454d-b311-58a498c7e748', '14e78f8e-ccca-4845-9c1c-b3f844988afe'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['cf5e0828-cc5a-4f17-8ec7-617bb1d01851', '13232f36-4cbb-42d3-a5a9-34f7b89c2f63', 'ff5fecc5-d2cb-4791-a351-4174148ff799', 'cf7624ab-e499-4e21-9822-d5b1255bfdcf'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f95a70ae-fc1c-413e-b28d-ffb14509abfa tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 29d596b0-e3db-406c-be4e-e93b3de20d7f: deleted successfully Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a13a19-ddf9-4bf6-ae5c-2f1d727142be]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:39 devstack sudo[94940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 Sep 07 17:01:39 devstack sudo[94940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:39 devstack sudo[94940]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[94945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7 Sep 07 17:01:40 devstack sudo[94945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack sudo[94945]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c01b604c-8717-4565-8eca-ccae4b2862f7" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-c01b604c-8717-4565-8eca-ccae4b2862f7" released by "delete_volume" :: held 0.919s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[564e56b1-8428-44c1-9e43-8ee6b7367059]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 Sep 07 17:01:40 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-746de93e-3746-487c-8175-955e1f7c956c tempest-GroupsTest-922347692 None] Group tempest-Group1-1964186231: creating Sep 07 17:01:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-746de93e-3746-487c-8175-955e1f7c956c tempest-GroupsTest-922347692 None] Group tempest-Group1-1964186231: created successfully Sep 07 17:01:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-746de93e-3746-487c-8175-955e1f7c956c tempest-GroupsTest-922347692 None] Create group completed successfully. Sep 07 17:01:40 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:40 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195 Sep 07 17:01:40 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:41 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-fe8b57ef-b371-47e1-b707-97141e5f7195" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-fe8b57ef-b371-47e1-b707-97141e5f7195" released by "delete_volume" :: held 0.825s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['492eee17-3910-44fc-b1f8-290d6c985824'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:41 devstack cinder-volume[86783]: WARNING cinder.quota [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-547265748 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-547265748, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['d12983a5-5466-4eda-8aed-2d02bb477801', '96281f77-0289-41c2-bb87-8cd0e8e7d9f0', '76f19fdf-a6d6-41ef-b38d-e5895f31d2c6', '5747776b-a585-4bd4-83fd-6f87a382056a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['d0f81af5-9f0e-46bc-90f0-e3068ab30b36', '7aead5ec-d0c8-424e-bd4a-fa931c35dc39', '9b068886-568d-4ef8-81e0-47a6cc72d5c9', 'e35f95ad-d01a-4868-b45f-566b10fd87a9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:41 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:41 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:41 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d4dba0f6-5b2d-4d92-b672-91a3e0c1c716 tempest-GroupSnapshotsTest-1520013021 None] Delete group completed successfully. Sep 07 17:01:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=124,cinder:SELECT=114,cinder:INSERT=32,cinder:DELETE=5 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-31f6b6ab-228d-4482-bc7a-87b74bae010e tempest-GroupsTest-922347692 None] Group tempest-Group2-1576697287: creating Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-31f6b6ab-228d-4482-bc7a-87b74bae010e tempest-GroupsTest-922347692 None] Group tempest-Group2-1576697287: created successfully Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-31f6b6ab-228d-4482-bc7a-87b74bae010e tempest-GroupsTest-922347692 None] Create group completed successfully. Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bd52f4b8-7ae3-4eef-b825-46b6442ea910 tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-1779126610: creating Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bd52f4b8-7ae3-4eef-b825-46b6442ea910 tempest-GroupSnapshotsTest-1520013021 None] Group tempest-GroupSnapshotsTest-Group-1779126610: created successfully Sep 07 17:01:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bd52f4b8-7ae3-4eef-b825-46b6442ea910 tempest-GroupSnapshotsTest-1520013021 None] Create group completed successfully. Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (37373a4b-9bd6-43ea-9148-ba2a360b6006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d18e778-68d1-4450-80f9-4b1fb4abd259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d18e778-68d1-4450-80f9-4b1fb4abd259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201640967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3061680a-4bac-4ae9-b4f7-1ee04b943a95,host='devstack@QuobyteHD#QuobyteHD',id=6297ebcc-99f9-4137-bb45-f5d5639e623d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:44Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fbbb27c-eb63-45ce-8114-4adb96a1999e),volume_type_id=2fbbb27c-eb63-45ce-8114-4adb96a1999e)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2ae359-c930-490e-8529-9909ff2b8d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c2ae359-c930-490e-8529-9909ff2b8d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddda8eb-5f49-44ff-ad00-490baa34d132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddda8eb-5f49-44ff-ad00-490baa34d132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6297ebcc-99f9-4137-bb45-f5d5639e623d', 'volume_name': 'volume-6297ebcc-99f9-4137-bb45-f5d5639e623d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef07b976-e706-466c-ac9f-cf199076291d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef07b976-e706-466c-ac9f-cf199076291d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3457fefd-b341-4a2a-b0a6-099b93386e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Volume 6297ebcc-99f9-4137-bb45-f5d5639e623d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6297ebcc-99f9-4137-bb45-f5d5639e623d', 'volume_size': 1} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3061680a-4bac-4ae9-b4f7-1ee04b943a95,created_at=2026-09-07T15:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-201640967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3061680a-4bac-4ae9-b4f7-1ee04b943a95,host='devstack@QuobyteHD#QuobyteHD',id=6297ebcc-99f9-4137-bb45-f5d5639e623d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:44Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fbbb27c-eb63-45ce-8114-4adb96a1999e),volume_type_id=2fbbb27c-eb63-45ce-8114-4adb96a1999e)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Creating volume 6297ebcc-99f9-4137-bb45-f5d5639e623d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:43 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:43 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d 1073741824 Sep 07 17:01:43 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (fa7d83cb-c0e2-41ad-bdb2-f4f3b01cdb79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c74424b-5861-4a1c-9f17-6a66e6b3b7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c74424b-5861-4a1c-9f17-6a66e6b3b7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1961026163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48569b2a-a14a-45b1-83b5-96c5e14a5b50,host='devstack@QuobyteHD#QuobyteHD',id=22f43c15-0f20-48b5-8dbd-01729185f7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:44Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ecbb308-f70f-4249-9641-21f881de5ebe),volume_type_id=0ecbb308-f70f-4249-9641-21f881de5ebe)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f116b0-397c-43df-a6d7-627d40e076dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f116b0-397c-43df-a6d7-627d40e076dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b58d5-016a-46c1-9614-800e9a224fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332b58d5-016a-46c1-9614-800e9a224fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22f43c15-0f20-48b5-8dbd-01729185f7f5', 'volume_name': 'volume-22f43c15-0f20-48b5-8dbd-01729185f7f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a8f101-1c2c-4387-ab39-61a31150c34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a8f101-1c2c-4387-ab39-61a31150c34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3955c22-c4bc-46c4-b6bb-ccbee5013c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Volume 22f43c15-0f20-48b5-8dbd-01729185f7f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22f43c15-0f20-48b5-8dbd-01729185f7f5', 'volume_size': 1} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:44 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d 1073741824" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:44 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d Sep 07 17:01:44 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:44 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.428s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=48569b2a-a14a-45b1-83b5-96c5e14a5b50,created_at=2026-09-07T15:01:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1961026163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=48569b2a-a14a-45b1-83b5-96c5e14a5b50,host='devstack@QuobyteHD#QuobyteHD',id=22f43c15-0f20-48b5-8dbd-01729185f7f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75b2c669a69e4ba4b86b102a1881af07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:44Z,use_quota=True,user_id='36358ffe5b6c4b16bda0ad4c577be9d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ecbb308-f70f-4249-9641-21f881de5ebe),volume_type_id=0ecbb308-f70f-4249-9641-21f881de5ebe)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Creating volume 22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:44 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:44 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 1073741824 Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3457fefd-b341-4a2a-b0a6-099b93386e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6297ebcc-99f9-4137-bb45-f5d5639e623d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb99330-fb7c-4491-800e-8a66d002709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Volume volume-6297ebcc-99f9-4137-bb45-f5d5639e623d (6297ebcc-99f9-4137-bb45-f5d5639e623d): created successfully Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb99330-fb7c-4491-800e-8a66d002709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (37373a4b-9bd6-43ea-9148-ba2a360b6006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6572ea7a-a5cb-4878-ae6f-7e7b7ec09bbd tempest-GroupsTest-922347692 None] Created volume successfully. Sep 07 17:01:45 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 1073741824" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:45 devstack sudo[94988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 Sep 07 17:01:45 devstack sudo[94988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:45 devstack sudo[94988]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3955c22-c4bc-46c4-b6bb-ccbee5013c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22f43c15-0f20-48b5-8dbd-01729185f7f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e204f94-21a3-4ad3-b931-2ed26d02cb59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:45 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Volume volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 (22f43c15-0f20-48b5-8dbd-01729185f7f5): created successfully Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e204f94-21a3-4ad3-b931-2ed26d02cb59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Flow 'volume_create_manager' (fa7d83cb-c0e2-41ad-bdb2-f4f3b01cdb79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-299b3cd6-6fbd-479c-be60-28a20be5a7bf tempest-GroupSnapshotsTest-1520013021 None] Created volume successfully. Sep 07 17:01:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Acquiring lock "cinder-quobyte-6297ebcc-99f9-4137-bb45-f5d5639e623d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-6297ebcc-99f9-4137-bb45-f5d5639e623d" acquired by "delete_volume" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[945ea60f-4492-470d-9baf-9c20e02e56ab]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:47 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d Sep 07 17:01:47 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] GroupSnapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: creating. Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Group snapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Creating offline snapshot bed592ea-687b-4ed9-8959-478f4613b4f7 of volume 22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bbd056-a9cf-4b19-8e2b-aa7a5bbea639]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:47 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d" returned: 0 in 0.537s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:47 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d Sep 07 17:01:47 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:47 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 Sep 07 17:01:47 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:47 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6297ebcc-99f9-4137-bb45-f5d5639e623d" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-6297ebcc-99f9-4137-bb45-f5d5639e623d" released by "delete_volume" :: held 0.991s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Created reservations ['d6c9dc7f-ab80-4859-934c-05156bf0b73a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-440650765 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-440650765, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:48 devstack cinder-volume[86783]: WARNING cinder.quota [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-440650765 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-440650765, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Created reservations ['b98a87f2-f439-4083-9d7f-e2342b57b385', '39f8940e-3f8d-48c8-ad56-35bb78bcf05a', 'b9cfa690-1a0a-4c75-9cbd-345a6909de1d', '75b99726-a381-4af3-8fe2-1bb61403c130'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:48 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5" returned: 0 in 0.711s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:48 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 1G Sep 07 17:01:48 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:48 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:48 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:48 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0198741d-1451-4929-97c6-07cee3660da8 tempest-GroupsTest-922347692 None] Delete group completed successfully. Sep 07 17:01:48 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 1G" returned: 0 in 0.790s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:48 devstack sudo[95013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 Sep 07 17:01:48 devstack sudo[95013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[95013]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 Sep 07 17:01:49 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info Sep 07 17:01:49 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Created reservations ['5ca671a1-c14f-42fe-89a9-4a0e08623d91'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:49 devstack sudo[95023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:49 devstack sudo[95023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:49 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:50 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info Sep 07 17:01:50 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:50 devstack sudo[95023]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5a690ec8-1ea4-4521-b0cf-0954adf4327a tempest-GroupsTest-922347692 None] Delete group completed successfully. Sep 07 17:01:50 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.info" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-676a0f34-8cc7-4bab-bb54-4bac6d732688 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: created successfully Sep 07 17:01:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: deleting Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-bed592ea-687b-4ed9-8959-478f4613b4f7" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-bed592ea-687b-4ed9-8959-478f4613b4f7" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Deleting offline snapshot bed592ea-687b-4ed9-8959-478f4613b4f7 of volume 22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:01:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] snapshot_file for this snap is: volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac745d5-c00e-4348-a09a-66ed07a6cd81]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 Sep 07 17:01:51 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfe3d813-37c2-4337-9c66-30e4da42e451 tempest-GroupsTest-922347692 None] Group tempest-GroupsTest-Group-1404228464: creating Sep 07 17:01:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfe3d813-37c2-4337-9c66-30e4da42e451 tempest-GroupsTest-922347692 None] Group tempest-GroupsTest-Group-1404228464: created successfully Sep 07 17:01:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bfe3d813-37c2-4337-9c66-30e4da42e451 tempest-GroupsTest-922347692 None] Create group completed successfully. Sep 07 17:01:51 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22f43c15-0f20-48b5-8dbd-01729185f7f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef5a295-c34e-4e6f-b662-2175cff331f5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:51 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 Sep 07 17:01:51 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:51 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:52 devstack sudo[95053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 Sep 07 17:01:52 devstack sudo[95053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:52 devstack sudo[95053]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:52 devstack sudo[95064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7 Sep 07 17:01:52 devstack sudo[95064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7a2e5f5-8dca-4a55-8bed-367e23292edf req-9a525335-0359-4692-bbf8-49f5b1bc6162 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7a2e5f5-8dca-4a55-8bed-367e23292edf req-9a525335-0359-4692-bbf8-49f5b1bc6162 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-b7a2e5f5-8dca-4a55-8bed-367e23292edf req-9a525335-0359-4692-bbf8-49f5b1bc6162 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-b7a2e5f5-8dca-4a55-8bed-367e23292edf req-9a525335-0359-4692-bbf8-49f5b1bc6162 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-e988ad6d-ba4f-4510-8816-fca116d8a470', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a12e20ca-24c4-4a68-b3db-fded32379b1b', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:01:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-b7a2e5f5-8dca-4a55-8bed-367e23292edf req-9a525335-0359-4692-bbf8-49f5b1bc6162 tempest-TestServerVolumeAttachmentScenario-1989742809 None] attachment_update completed successfully. Sep 07 17:01:52 devstack sudo[95064]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5.bed592ea-687b-4ed9-8959-478f4613b4f7" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-bed592ea-687b-4ed9-8959-478f4613b4f7" released by "_delete_snapshot" :: held 1.837s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" released by "delete_snapshot" :: held 1.865s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:52 devstack cinder-volume[86783]: WARNING cinder.quota [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1900741452 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1900741452, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:52 devstack cinder-volume[86783]: WARNING cinder.quota [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1900741452 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1900741452, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['805f4705-75ec-42aa-9f58-cb73b621c417', '4fdb1251-aab6-4297-a465-cfd161ff4792', 'c335233c-0a1f-415e-ab59-1328f3cd72b2', '451ccc6e-06eb-41ab-849e-ab768a004835'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c3a4e12d-2b54-4348-b0ed-19b056627698 tempest-GroupSnapshotsTest-1520013021 None] group_snapshot 0751572f-3141-4d81-b9df-0927ab02cf1b: deleted successfully Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (32e0d084-e0c0-4ef9-9d55-4240f6a2569a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e871a-c828-4812-8776-fdf7b7b1f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (648e871a-c828-4812-8776-fdf7b7b1f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1193679389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74ca5179-dd85-496b-bcee-74148ac06d48,host='devstack@QuobyteHD#QuobyteHD',id=348852fb-1cf0-48b1-80d3-dc5f2e3505c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:53Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a),volume_type_id=c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96ff0b7-e756-44a0-a39c-b34ea97c8479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f96ff0b7-e756-44a0-a39c-b34ea97c8479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e406741d-b044-4b96-b633-318a36c1eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e406741d-b044-4b96-b633-318a36c1eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '348852fb-1cf0-48b1-80d3-dc5f2e3505c7', 'volume_name': 'volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d502ba-84e1-4307-b3a4-fc5a2b928bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d502ba-84e1-4307-b3a4-fc5a2b928bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1879051a-4f7e-4b95-8ba5-4db64a7e2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Volume 348852fb-1cf0-48b1-80d3-dc5f2e3505c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7', 'volume_size': 1} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74ca5179-dd85-496b-bcee-74148ac06d48,created_at=2026-09-07T15:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1193679389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74ca5179-dd85-496b-bcee-74148ac06d48,host='devstack@QuobyteHD#QuobyteHD',id=348852fb-1cf0-48b1-80d3-dc5f2e3505c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:53Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a),volume_type_id=c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Creating volume 348852fb-1cf0-48b1-80d3-dc5f2e3505c7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:53 devstack sudo[95459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 1073741824 Sep 07 17:01:53 devstack sudo[95459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a0fe1a3-c41c-4bf8-88a3-2dbb63f00746]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:01:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[95464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 Sep 07 17:01:54 devstack sudo[95464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[95459]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 1073741824" returned: 0 in 0.707s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[95468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 Sep 07 17:01:54 devstack sudo[95468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[95464]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:54 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5 Sep 07 17:01:54 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:54 devstack sudo[95468]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1879051a-4f7e-4b95-8ba5-4db64a7e2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1e1601-0a9d-4c5e-a121-ce11fa7b6f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Volume volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 (348852fb-1cf0-48b1-80d3-dc5f2e3505c7): created successfully Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a1e1601-0a9d-4c5e-a121-ce11fa7b6f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (32e0d084-e0c0-4ef9-9d55-4240f6a2569a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-205d9213-e18a-4ac4-a77a-4a4d26f56c0d tempest-GroupsTest-922347692 None] Created volume successfully. Sep 07 17:01:54 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-22f43c15-0f20-48b5-8dbd-01729185f7f5" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Lock "cinder-quobyte-22f43c15-0f20-48b5-8dbd-01729185f7f5" released by "delete_volume" :: held 0.877s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['40ff1dc8-e101-49fd-9915-fc58e124f1e4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:54 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1900741452 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1900741452, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Created reservations ['1a0d6aab-2048-4eed-8b2e-29efb019a13f', 'f4735a04-1500-4347-ba62-536aff15ef16', '80a6587a-7608-488b-83bc-d91815142f58', 'cbb0eaa5-0bb4-46c1-9f26-a7457b1ff12b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:55 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:01:55 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:55 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:55 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:01:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f96a8be3-bb6a-465d-b00a-4bdd6ab96d47 tempest-GroupSnapshotsTest-1520013021 None] Delete group completed successfully. Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (9787daa9-1bf2-4ad1-a92a-f1048e22358c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab49fc6-5c18-492b-8de2-f5614e846bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab49fc6-5c18-492b-8de2-f5614e846bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276382419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74ca5179-dd85-496b-bcee-74148ac06d48,host='devstack@QuobyteHD#QuobyteHD',id=202fb2bd-5122-4d33-9f4f-ab604c43da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:57Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a),volume_type_id=c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790066fc-0e6a-4cbe-b157-da8f7797c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (790066fc-0e6a-4cbe-b157-da8f7797c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698be3ce-d84f-4ec9-9ece-de9ef5ce29e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (698be3ce-d84f-4ec9-9ece-de9ef5ce29e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '202fb2bd-5122-4d33-9f4f-ab604c43da0f', 'volume_name': 'volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7d1307-1a5d-42af-8766-d8a22d033ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7d1307-1a5d-42af-8766-d8a22d033ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181de9c-0d87-41e3-8827-e20362865860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Volume 202fb2bd-5122-4d33-9f4f-ab604c43da0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f', 'volume_size': 1} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=74ca5179-dd85-496b-bcee-74148ac06d48,created_at=2026-09-07T15:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1276382419',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=74ca5179-dd85-496b-bcee-74148ac06d48,host='devstack@QuobyteHD#QuobyteHD',id=202fb2bd-5122-4d33-9f4f-ab604c43da0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66c22d7f199147b98284eedf982cd49f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:01:57Z,use_quota=True,user_id='d9cee5610ca1413da7e6051a96db12ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a),volume_type_id=c512fe32-c3f9-4dcf-aaf4-39e543bc5f1a)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Creating volume 202fb2bd-5122-4d33-9f4f-ab604c43da0f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:01:57 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:01:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:57 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f 1073741824 Sep 07 17:01:57 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:58 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f 1073741824" returned: 0 in 0.739s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:01:58 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f Sep 07 17:01:58 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:01:58 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9181de9c-0d87-41e3-8827-e20362865860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e7c15b-2442-474e-b360-463ffaab9e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:01:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Volume volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f (202fb2bd-5122-4d33-9f4f-ab604c43da0f): created successfully Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26e7c15b-2442-474e-b360-463ffaab9e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:01:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Flow 'volume_create_manager' (9787daa9-1bf2-4ad1-a92a-f1048e22358c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:01:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-57d21a09-1cb5-48d2-b597-971c53e05441 tempest-GroupsTest-922347692 None] Created volume successfully. Sep 07 17:02:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9a1e49d-1db1-40e7-adff-7f407c5de9e6 tempest-GroupsTest-922347692 None] Update group completed successfully. Sep 07 17:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-73061605-82c1-4dcd-9e26-157bf6e51f23 req-6b244796-6398-4d34-87c2-0e72c518cc5e tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-73061605-82c1-4dcd-9e26-157bf6e51f23 req-6b244796-6398-4d34-87c2-0e72c518cc5e tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-73061605-82c1-4dcd-9e26-157bf6e51f23 req-6b244796-6398-4d34-87c2-0e72c518cc5e tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-73061605-82c1-4dcd-9e26-157bf6e51f23 req-6b244796-6398-4d34-87c2-0e72c518cc5e tempest-TestServerVolumeAttachmentScenario-1989742809 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-5a56db29-c38f-473d-8879-e06be5631986', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d718145-43aa-41be-920a-cdb93a0269ad', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:02:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-73061605-82c1-4dcd-9e26-157bf6e51f23 req-6b244796-6398-4d34-87c2-0e72c518cc5e tempest-TestServerVolumeAttachmentScenario-1989742809 None] attachment_update completed successfully. Sep 07 17:02:01 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:DELETE=6,cinder:SELECT=171,cinder:UPDATE=166,cinder:INSERT=31 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:02:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-99bcc62b-fca0-4f8a-bed2-1fbe552a09c4 tempest-GroupsTest-922347692 None] Update group completed successfully. Sep 07 17:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Acquiring lock "cinder-quobyte-202fb2bd-5122-4d33-9f4f-ab604c43da0f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-202fb2bd-5122-4d33-9f4f-ab604c43da0f" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfcb13b-98ca-4b22-a46d-ae44d24cb86c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a4e4578f-7e62-402f-b8e3-ef1a61fe437f req-9ce6cdf7-8d3a-4f12-8552-8221b17b6cb1 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Terminate volume connection completed successfully. Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a4e4578f-7e62-402f-b8e3-ef1a61fe437f req-9ce6cdf7-8d3a-4f12-8552-8221b17b6cb1 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Deleting attachment 2d718145-43aa-41be-920a-cdb93a0269ad. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:02:04 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f Sep 07 17:02:04 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:04 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:04 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f Sep 07 17:02:04 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:04 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-202fb2bd-5122-4d33-9f4f-ab604c43da0f" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-202fb2bd-5122-4d33-9f4f-ab604c43da0f" released by "delete_volume" :: held 1.003s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Acquiring lock "cinder-quobyte-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa84555-f089-46be-ae11-73f149a76e05]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:05 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 Sep 07 17:02:05 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-70e17a72-2aa4-444d-8a9c-4df0ae4b1a99 tempest-GroupSnapshotsV319Test-581530118 None] Group tempest-GroupSnapshotsV319Test-Group-1212680910: creating Sep 07 17:02:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-70e17a72-2aa4-444d-8a9c-4df0ae4b1a99 tempest-GroupSnapshotsV319Test-581530118 None] Group tempest-GroupSnapshotsV319Test-Group-1212680910: created successfully Sep 07 17:02:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-70e17a72-2aa4-444d-8a9c-4df0ae4b1a99 tempest-GroupSnapshotsV319Test-581530118 None] Create group completed successfully. Sep 07 17:02:05 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" returned: 0 in 0.785s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:05 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7 Sep 07 17:02:05 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:06 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" returned: 0 in 0.530s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "cinder-quobyte-348852fb-1cf0-48b1-80d3-dc5f2e3505c7" released by "delete_volume" :: held 1.370s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Created reservations ['5c1ac35b-ead2-41aa-af1c-051788c911c0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:06 devstack cinder-volume[86783]: WARNING cinder.quota [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-79854600 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-79854600, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:02:06 devstack cinder-volume[86783]: WARNING cinder.quota [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-79854600 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-79854600, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:02:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Created reservations ['5c9cb342-a9f4-425d-b273-d23cf060d23d', '00b09037-a9a1-4d10-b16f-0bdbbefa90ad', '3ab3eb5a-c056-4261-8aa6-18b8dfc5d709', '4da35884-173d-4ecc-8fa6-dbf9046d829f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-3dfe1bee-0f69-4adc-9d0f-920afee187fa req-812d2c14-9df1-41cd-94c0-6c24604c9885 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Terminate volume connection completed successfully. Sep 07 17:02:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-3dfe1bee-0f69-4adc-9d0f-920afee187fa req-812d2c14-9df1-41cd-94c0-6c24604c9885 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Deleting attachment a12e20ca-24c4-4a68-b3db-fded32379b1b. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Created reservations ['cd69b4a7-267e-494b-918d-371be57a15d3', 'f2ea1d84-e93c-4a0c-bc18-3b531bbab9c0', '5d1bdbc5-dafe-46ae-b5b2-8613ac428446', '9112f752-ecbd-4f74-843a-8ddf4f8c431f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:07 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:07 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Flow 'volume_create_manager' (103ff6d9-7eb1-498b-853e-df38061f9b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dfbd19-5f3c-487f-931f-beaac5c7cdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dfbd19-5f3c-487f-931f-beaac5c7cdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747956929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63ab7523-6110-4091-91ef-3059508acf5c,host='devstack@QuobyteHD#QuobyteHD',id=66d6c869-3c74-4652-8df7-7d624a80fabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b364c09dedf746458f633b4775bf299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:08Z,use_quota=True,user_id='ccf68166da154243a0d879dad4169fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2708cdf4-8683-4185-b693-363bdc885bb1),volume_type_id=2708cdf4-8683-4185-b693-363bdc885bb1)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc29848b-0763-4c0a-b600-da2287ed683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc29848b-0763-4c0a-b600-da2287ed683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2531824c-7dba-4eff-917d-bb5ebbbae37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2531824c-7dba-4eff-917d-bb5ebbbae37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66d6c869-3c74-4652-8df7-7d624a80fabb', 'volume_name': 'volume-66d6c869-3c74-4652-8df7-7d624a80fabb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c61dfd-6c60-4e50-bf0b-2864f86116c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c61dfd-6c60-4e50-bf0b-2864f86116c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc74b72-f21c-4a63-a1ab-01be80d64638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Volume 66d6c869-3c74-4652-8df7-7d624a80fabb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66d6c869-3c74-4652-8df7-7d624a80fabb', 'volume_size': 1} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=63ab7523-6110-4091-91ef-3059508acf5c,created_at=2026-09-07T15:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1747956929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=63ab7523-6110-4091-91ef-3059508acf5c,host='devstack@QuobyteHD#QuobyteHD',id=66d6c869-3c74-4652-8df7-7d624a80fabb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b364c09dedf746458f633b4775bf299b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:08Z,use_quota=True,user_id='ccf68166da154243a0d879dad4169fcf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2708cdf4-8683-4185-b693-363bdc885bb1),volume_type_id=2708cdf4-8683-4185-b693-363bdc885bb1)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Creating volume 66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:02:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:08 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.779s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:08 devstack sudo[95643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb 1073741824 Sep 07 17:02:08 devstack sudo[95643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9e03769d-fea5-4c93-8dcf-306ac89f9480 tempest-GroupsTest-922347692 None] Delete group completed successfully. Sep 07 17:02:08 devstack sudo[95643]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb 1073741824" returned: 0 in 1.005s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:09 devstack sudo[95671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb Sep 07 17:02:09 devstack sudo[95671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:09 devstack sudo[95671]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbc74b72-f21c-4a63-a1ab-01be80d64638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66d6c869-3c74-4652-8df7-7d624a80fabb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdce68b-a93e-401e-9dcb-ab233778acde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Volume volume-66d6c869-3c74-4652-8df7-7d624a80fabb (66d6c869-3c74-4652-8df7-7d624a80fabb): created successfully Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cdce68b-a93e-401e-9dcb-ab233778acde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Flow 'volume_create_manager' (103ff6d9-7eb1-498b-853e-df38061f9b3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-297fb112-344f-4ed6-8f7d-086ef7dc17ec tempest-GroupSnapshotsV319Test-581530118 None] Created volume successfully. Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:09 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:09 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:10 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:02:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:02:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:02:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] GroupSnapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: creating. Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Group snapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: creating. {{(pid=86783) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Creating offline snapshot 6f869291-274e-48a4-8b65-52ac5c792560 of volume 66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f633c-1db2-4838-a984-ec9a9d11d1bc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:11 devstack sudo[95680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb Sep 07 17:02:11 devstack sudo[95680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:11 devstack sudo[95680]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb" returned: 0 in 0.666s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:11 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 1G Sep 07 17:02:11 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:12 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 1G" returned: 0 in 0.703s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d6c869-3c74-4652-8df7-7d624a80fabb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:12 devstack sudo[95692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d6c869-3c74-4652-8df7-7d624a80fabb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 Sep 07 17:02:12 devstack sudo[95692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:13 devstack sudo[95692]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66d6c869-3c74-4652-8df7-7d624a80fabb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:13 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 Sep 07 17:02:13 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:13 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:13 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info Sep 07 17:02:13 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "cinder-5a56db29-c38f-473d-8879-e06be5631986-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-5a56db29-c38f-473d-8879-e06be5631986-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "cinder-quobyte-5a56db29-c38f-473d-8879-e06be5631986" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-quobyte-5a56db29-c38f-473d-8879-e06be5631986" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:13 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad273d0f-4672-43d9-aef2-274c31535ce6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:13 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info Sep 07 17:02:13 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:13 devstack sudo[95705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 Sep 07 17:02:13 devstack sudo[95705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.info" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.065s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:14 devstack sudo[95705]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986" returned: 0 in 0.439s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986 Sep 07 17:02:14 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d1e57a36-aeec-4da3-84ee-cafe98debd7f tempest-GroupSnapshotsV319Test-581530118 None] group_snapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: created successfully Sep 07 17:02:14 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5a56db29-c38f-473d-8879-e06be5631986" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-quobyte-5a56db29-c38f-473d-8879-e06be5631986" released by "delete_volume" :: held 0.868s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Created reservations ['ad82df2e-fcf0-470e-bb97-bbbf642f7b2e', 'cfdc7973-be2f-4f21-bc07-9582e766a219', 'fd448c31-bb15-4061-86ff-6cb9cf377db9', 'c8e5770b-1685-4dfa-bdb5-90167cd2bf93'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:14 devstack sudo[95715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:14 devstack sudo[95715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:15 devstack sudo[95715]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:15 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Deleted volume successfully. Sep 07 17:02:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-696b028f-6057-4e28-82a2-9252e690a427 tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-5a56db29-c38f-473d-8879-e06be5631986-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] group_snapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: deleting Sep 07 17:02:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] group_snapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: deleting {{(pid=86783) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "cinder-e988ad6d-ba4f-4510-8816-fca116d8a470-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-e988ad6d-ba4f-4510-8816-fca116d8a470-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "cinder-quobyte-6f869291-274e-48a4-8b65-52ac5c792560" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-6f869291-274e-48a4-8b65-52ac5c792560" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Deleting offline snapshot 6f869291-274e-48a4-8b65-52ac5c792560 of volume 66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] snapshot_file for this snap is: volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "cinder-quobyte-e988ad6d-ba4f-4510-8816-fca116d8a470" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbb8557-f14c-4250-9605-d762014020fe]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-quobyte-e988ad6d-ba4f-4510-8816-fca116d8a470" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[31698235-fd99-435d-8ccc-cf5123d8ba19]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 Sep 07 17:02:16 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 Sep 07 17:02:16 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66d6c869-3c74-4652-8df7-7d624a80fabb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[519205be-8fe4-4fb1-a2d6-74cc528b6e12]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470" returned: 0 in 0.455s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:16 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470 Sep 07 17:02:16 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:16 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb Sep 07 17:02:16 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e988ad6d-ba4f-4510-8816-fca116d8a470" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-quobyte-e988ad6d-ba4f-4510-8816-fca116d8a470" released by "delete_volume" :: held 0.806s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Created reservations ['b44a096b-160d-4a71-a9c8-adbd5718a49f', 'd82813ad-69cb-4d45-9f4a-61a2e333c695', '909229a4-09e6-4ce9-a3e5-d3bd04a8cd78', '51816507-bbdf-4580-9925-725c2dc05b53'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:17 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 Sep 07 17:02:17 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:17 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.307s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Deleted volume successfully. Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4c68ac3e-b838-41fd-9e29-2dc1c9ccc07b tempest-TestServerVolumeAttachmentScenario-1989742809 None] Lock "cinder-e988ad6d-ba4f-4510-8816-fca116d8a470-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:17 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:17 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560 Sep 07 17:02:17 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:17 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb.6f869291-274e-48a4-8b65-52ac5c792560" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-6f869291-274e-48a4-8b65-52ac5c792560" released by "_delete_snapshot" :: held 1.828s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" released by "delete_snapshot" :: held 1.900s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:18 devstack cinder-volume[86783]: WARNING cinder.quota [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2020830065 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-2020830065, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:02:18 devstack cinder-volume[86783]: WARNING cinder.quota [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-2020830065 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-2020830065, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] Created reservations ['9570c5d6-59ea-467d-8f3e-07ab52b4df5f', 'a4a4786a-f9ae-497d-8eda-67abfb058c4c', '07fd7aa2-8208-49b5-af15-c41f76ebd1e8', 'e8491ef3-ba00-41ae-b546-6933c66ddf32'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-72b671a7-8457-43ac-a9b6-1c156258d4ba tempest-GroupSnapshotsV319Test-581530118 None] group_snapshot 5040ca97-d2fb-4b46-b8a0-8f5dcb07e3d4: deleted successfully Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e45ac9-cc14-40b4-8ec6-b353ca2af04e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:18 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb Sep 07 17:02:18 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:19 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb" returned: 0 in 0.453s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:19 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb Sep 07 17:02:19 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:19 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-66d6c869-3c74-4652-8df7-7d624a80fabb" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Lock "cinder-quobyte-66d6c869-3c74-4652-8df7-7d624a80fabb" released by "delete_volume" :: held 0.835s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Created reservations ['7a2bfbeb-ad13-44be-ac87-0f0de6d14388'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:19 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-2020830065 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-2020830065, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Created reservations ['d52f0104-e2ca-4240-9651-0e94ac45091c', '8b8526c4-3bb7-4792-a9f6-15f648d42dfa', 'a7520a56-4771-407f-8eb9-bceab8133c61', '3df1af44-e716-4355-b87b-f9805994bb35'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:19 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:19 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:20 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:20 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f597a9c5-0120-4119-a031-3514248c2419 tempest-GroupSnapshotsV319Test-581530118 None] Delete group completed successfully. Sep 07 17:02:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0807c96a-d474-438a-94b8-f6c3dfe35d15 tempest-GroupsV320Test-1419730056 None] Group tempest-GroupsV320Test-Group-698914438: creating Sep 07 17:02:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0807c96a-d474-438a-94b8-f6c3dfe35d15 tempest-GroupsV320Test-1419730056 None] Group tempest-GroupsV320Test-Group-698914438: created successfully Sep 07 17:02:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0807c96a-d474-438a-94b8-f6c3dfe35d15 tempest-GroupsV320Test-1419730056 None] Create group completed successfully. Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (1caa8cf6-53a1-4255-9e31-fe341105f42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1455003-4d08-49dd-8bec-d446aa84db42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1455003-4d08-49dd-8bec-d446aa84db42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1044033074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e3d018-9e8e-469d-a519-cbd14e9ab0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:30Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a22642-44a8-46ce-86c8-773e45508dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11a22642-44a8-46ce-86c8-773e45508dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3cb6d5-9bd6-494a-940d-40b38dd57819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e3cb6d5-9bd6-494a-940d-40b38dd57819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e3d018-9e8e-469d-a519-cbd14e9ab0cf', 'volume_name': 'volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e017c92a-a461-4f8b-b90b-6dd2e639de10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e017c92a-a461-4f8b-b90b-6dd2e639de10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5297143-af14-41be-89d0-0b86416a09c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Volume f4e3d018-9e8e-469d-a519-cbd14e9ab0cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf', 'volume_size': 1} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1044033074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4e3d018-9e8e-469d-a519-cbd14e9ab0cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:30Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Creating volume f4e3d018-9e8e-469d-a519-cbd14e9ab0cf {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:02:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:29 devstack sudo[95804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf 1073741824 Sep 07 17:02:29 devstack sudo[95804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Created reservations ['7191cfe9-b299-4b7e-9185-de0db5d2c918'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack sudo[95810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:30 devstack sudo[95810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack sudo[95804]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf 1073741824" returned: 0 in 0.638s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:30 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf Sep 07 17:02:30 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:30 devstack sudo[95810]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-85695a9e-4e17-449c-9d77-663a6e8ef4ba tempest-GroupsV320Test-1419730056 None] Delete group completed successfully. Sep 07 17:02:30 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5297143-af14-41be-89d0-0b86416a09c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3223a91e-f419-4b61-a4c5-a129918edac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Volume volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf (f4e3d018-9e8e-469d-a519-cbd14e9ab0cf): created successfully Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3223a91e-f419-4b61-a4c5-a129918edac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (1caa8cf6-53a1-4255-9e31-fe341105f42c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0e55f8a5-a322-44d6-9a9d-c231ed26a8a2 tempest-AttachVolumeTestJSON-618796532 None] Created volume successfully. Sep 07 17:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-02a8ffa3-d184-464e-b42b-d7dfc034ced2 req-7088199e-1033-4e1d-9dbc-76fc5c4d0cf4 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-02a8ffa3-d184-464e-b42b-d7dfc034ced2 req-7088199e-1033-4e1d-9dbc-76fc5c4d0cf4 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-02a8ffa3-d184-464e-b42b-d7dfc034ced2 req-7088199e-1033-4e1d-9dbc-76fc5c4d0cf4 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-02a8ffa3-d184-464e-b42b-d7dfc034ced2 req-7088199e-1033-4e1d-9dbc-76fc5c4d0cf4 tempest-AttachVolumeTestJSON-618796532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '843b8ad6-b9fb-4cf1-9559-03173173f62a', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:02:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-02a8ffa3-d184-464e-b42b-d7dfc034ced2 req-7088199e-1033-4e1d-9dbc-76fc5c4d0cf4 tempest-AttachVolumeTestJSON-618796532 None] attachment_update completed successfully. Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Flow 'volume_create_manager' (86c485ce-fe6c-499a-8fd9-cd0fad01f43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcec73db-b936-4734-9a7b-8d5f230e5e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcec73db-b936-4734-9a7b-8d5f230e5e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1465686958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f50ae5-b5a5-461c-ba61-6b779544adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266e407545ab40f1b068865ba76cab4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:35Z,use_quota=True,user_id='26b6005d5e6e42cea981725bf7af39f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826bbf76-1924-4b45-9fac-2b8159f5d54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826bbf76-1924-4b45-9fac-2b8159f5d54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5713a310-1d0c-488b-b21c-5112cc3481c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5713a310-1d0c-488b-b21c-5112cc3481c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f50ae5-b5a5-461c-ba61-6b779544adff', 'volume_name': 'volume-31f50ae5-b5a5-461c-ba61-6b779544adff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4e627-0a2f-45ee-80de-f3927e7a7cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65d4e627-0a2f-45ee-80de-f3927e7a7cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de44181-0001-455b-9492-12af93596683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Volume 31f50ae5-b5a5-461c-ba61-6b779544adff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f50ae5-b5a5-461c-ba61-6b779544adff', 'volume_size': 1} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1465686958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f50ae5-b5a5-461c-ba61-6b779544adff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='266e407545ab40f1b068865ba76cab4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:35Z,use_quota=True,user_id='26b6005d5e6e42cea981725bf7af39f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Creating volume 31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:02:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:34 devstack sudo[96247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff 1073741824 Sep 07 17:02:34 devstack sudo[96247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:35 devstack sudo[96247]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff 1073741824" returned: 0 in 0.719s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:35 devstack sudo[96260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff Sep 07 17:02:35 devstack sudo[96260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:35 devstack sudo[96260]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1de44181-0001-455b-9492-12af93596683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f50ae5-b5a5-461c-ba61-6b779544adff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e5018-4af0-483b-b515-df1f6f14b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Volume volume-31f50ae5-b5a5-461c-ba61-6b779544adff (31f50ae5-b5a5-461c-ba61-6b779544adff): created successfully Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (420e5018-4af0-483b-b515-df1f6f14b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Flow 'volume_create_manager' (86c485ce-fe6c-499a-8fd9-cd0fad01f43c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff55643b-9f40-4d4c-9bb0-166738b503ab tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Created volume successfully. Sep 07 17:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Creating offline snapshot 152716ee-24cb-46d4-961a-addfe632e1df of volume 31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31e8a59-e26d-4341-a9f0-f4fca1902e01]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:37 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff Sep 07 17:02:37 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:37 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:37 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df 1G Sep 07 17:02:37 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df 1G" returned: 0 in 0.625s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f50ae5-b5a5-461c-ba61-6b779544adff -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f50ae5-b5a5-461c-ba61-6b779544adff -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df Sep 07 17:02:38 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31f50ae5-b5a5-461c-ba61-6b779544adff -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df is being set with open permissions: ugo+rw Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[96279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df Sep 07 17:02:38 devstack sudo[96279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:38 devstack sudo[96279]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:38 devstack sudo[96282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info Sep 07 17:02:38 devstack sudo[96282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:39 devstack sudo[96282]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:39 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info is being set with open permissions: ugo+rw Sep 07 17:02:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:39 devstack sudo[96323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info Sep 07 17:02:39 devstack sudo[96323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:39 devstack sudo[96323]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.info" returned: 0 in 0.477s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.958s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c7e16a66-4822-4d11-aae2-e3c90d8e8884 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Create snapshot completed successfully Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Flow 'volume_create_manager' (6f0f62bd-7919-40c4-8a40-e3a83e5f9e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e209cafb-60bc-4045-bab9-4e0b3aabd448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e209cafb-60bc-4045-bab9-4e0b3aabd448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-680631362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cbfa51-cc28-4447-b1db-ec3d1bf9f973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4c809c71c249e68d3e8232d1fe4480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:40Z,use_quota=True,user_id='c2f1047930fa404bb9a2890c1797e635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54513149-8a88-4b1e-9c3c-20215fd5a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54513149-8a88-4b1e-9c3c-20215fd5a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772dc4ca-c539-4e2a-968a-47211b0c24e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (772dc4ca-c539-4e2a-968a-47211b0c24e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32cbfa51-cc28-4447-b1db-ec3d1bf9f973', 'volume_name': 'volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fab6745-a6fd-4058-9a9e-9431868ef7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fab6745-a6fd-4058-9a9e-9431868ef7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec0be45-689a-4b99-9cd4-fda3d6905d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973', 'volume_size': 1} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-680631362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cbfa51-cc28-4447-b1db-ec3d1bf9f973,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f4c809c71c249e68d3e8232d1fe4480',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:02:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:02:40Z,use_quota=True,user_id='c2f1047930fa404bb9a2890c1797e635',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Creating volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:02:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:02:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:40 devstack sudo[96408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 1073741824 Sep 07 17:02:40 devstack sudo[96408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "cinder-152716ee-24cb-46d4-961a-addfe632e1df-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-152716ee-24cb-46d4-961a-addfe632e1df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "cinder-quobyte-152716ee-24cb-46d4-961a-addfe632e1df" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-152716ee-24cb-46d4-961a-addfe632e1df" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Deleting offline snapshot 152716ee-24cb-46d4-961a-addfe632e1df of volume 31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] snapshot_file for this snap is: volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4cfc32-d23c-474a-bc9c-9b3a2f595be3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:41 devstack sudo[96408]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 1073741824" returned: 0 in 0.995s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:41 devstack sudo[96775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df Sep 07 17:02:41 devstack sudo[96775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:41 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 Sep 07 17:02:41 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:42 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" returned: 0 in 0.593s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec0be45-689a-4b99-9cd4-fda3d6905d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698058a1-e9c2-417b-8b19-f4689eae7613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=118,cinder:SELECT=137,cinder:INSERT=31,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:02:42 devstack sudo[96775]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df" returned: 0 in 0.807s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31f50ae5-b5a5-461c-ba61-6b779544adff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Volume volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 (32cbfa51-cc28-4447-b1db-ec3d1bf9f973): created successfully Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698058a1-e9c2-417b-8b19-f4689eae7613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Flow 'volume_create_manager' (6f0f62bd-7919-40c4-8a40-e3a83e5f9e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42502ad-7b63-4e50-930b-bcadb4876a17]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9e6f64e6-bc45-4ba4-97f7-8768669b4df2 tempest-SnapshotsActionsTest-1514216551 None] Created volume successfully. Sep 07 17:02:42 devstack sudo[96806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff Sep 07 17:02:42 devstack sudo[96806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Creating offline snapshot 197a88fe-f4bf-4e0c-a9ca-ac361a658d05 of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d36e1d-2d60-4318-9627-44ad67d0fab1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:43 devstack sudo[96806]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff" returned: 0 in 0.805s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:43 devstack sudo[96815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df Sep 07 17:02:43 devstack sudo[96815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:43 devstack sudo[96814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 Sep 07 17:02:43 devstack sudo[96814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:43 devstack sudo[96815]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df" returned: 0 in 0.655s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:43 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df Sep 07 17:02:43 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:43 devstack sudo[96814]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" returned: 0 in 0.892s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:43 devstack sudo[96829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 1G Sep 07 17:02:43 devstack sudo[96829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:44 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff.152716ee-24cb-46d4-961a-addfe632e1df" returned: 0 in 0.560s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-152716ee-24cb-46d4-961a-addfe632e1df" released by "_delete_snapshot" :: held 3.006s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" released by "delete_snapshot" :: held 3.048s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Created reservations ['1b0fd31d-3b11-419d-9f74-9a6ae3614d98', '541a52e5-fba9-4796-8c4d-9449b9be22b5', 'd19f0218-4c41-48dc-a692-fc0cf2c43e3c', 'a8d3df3a-dd6f-4759-9ad3-d0e9707957f1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Delete snapshot completed successfully. Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-20f16032-bb34-4229-8acf-22dd7ef9f694 tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-152716ee-24cb-46d4-961a-addfe632e1df-delete_snapshot" released by "delete_snapshot" :: held 3.286s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:44 devstack sudo[96829]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 1G" returned: 0 in 0.670s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:44 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:44 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:44 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:44 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 is being set with open permissions: ugo+rw Sep 07 17:02:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:45 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:45 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:45 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:45 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info Sep 07 17:02:45 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "cinder-31f50ae5-b5a5-461c-ba61-6b779544adff-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-31f50ae5-b5a5-461c-ba61-6b779544adff-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:46 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info" returned: 0 in 0.533s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:46 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info is being set with open permissions: ugo+rw Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:46 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info Sep 07 17:02:46 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f69304-8ba2-4218-add4-592f886b7309]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:46 devstack sudo[96850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff Sep 07 17:02:46 devstack sudo[96850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:46 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.info" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.542s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-913a2462-2847-4519-abfc-e400f6578e4c tempest-SnapshotsActionsTest-1514216551 None] Create snapshot completed successfully Sep 07 17:02:46 devstack sudo[96850]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff" returned: 0 in 0.558s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:46 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff Sep 07 17:02:46 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:47 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-31f50ae5-b5a5-461c-ba61-6b779544adff" returned: 0 in 0.439s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-quobyte-31f50ae5-b5a5-461c-ba61-6b779544adff" released by "delete_volume" :: held 1.123s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Created reservations ['a54456b7-c102-419f-95cc-d975492231a0', '20044c88-adb0-48fe-9c55-dee7b7602610', 'a3ddde25-737b-40b8-bd3a-5979443fbbbb', 'b3c2e749-6b03-4b70-9401-8c34b3a761f1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:47 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:02:47 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:47 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:02:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Deleted volume successfully. Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bcf71287-5399-4148-aef8-e9354c2418af tempest-VolumeSnapshotQuotasNegativeTestJSON-1979325228 None] Lock "cinder-31f50ae5-b5a5-461c-ba61-6b779544adff-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Creating offline snapshot 920fd347-a04d-4134-a1aa-f81bc891f60b of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6474d6b-99ac-4bce-8574-c13faadadbb6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:48 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:48 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:48 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:48 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b 1G Sep 07 17:02:48 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b 1G" returned: 0 in 0.703s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:49 devstack sudo[96876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b Sep 07 17:02:49 devstack sudo[96876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[96876]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:49 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b is being set with open permissions: ugo+rw Sep 07 17:02:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:49 devstack sudo[96882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b Sep 07 17:02:49 devstack sudo[96882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:49 devstack sudo[96882]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.054s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a52d1c92-ef63-45fe-a80d-e9d3b124f5f8 tempest-SnapshotsActionsTest-1514216551 None] Create snapshot completed successfully Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-920fd347-a04d-4134-a1aa-f81bc891f60b-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-920fd347-a04d-4134-a1aa-f81bc891f60b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-920fd347-a04d-4134-a1aa-f81bc891f60b" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-920fd347-a04d-4134-a1aa-f81bc891f60b" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Deleting offline snapshot 920fd347-a04d-4134-a1aa-f81bc891f60b of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] snapshot_file for this snap is: volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6af621-cac5-4909-8c0b-ad7fa986d2a2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:50 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b Sep 07 17:02:50 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:51 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b065bd7c-74e6-48f7-8a24-6a565dd81be1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:51 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:51 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:51 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:51 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b Sep 07 17:02:51 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:52 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b" returned: 0 in 0.574s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:52 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b Sep 07 17:02:52 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:52 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.920fd347-a04d-4134-a1aa-f81bc891f60b" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-920fd347-a04d-4134-a1aa-f81bc891f60b" released by "_delete_snapshot" :: held 2.170s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_snapshot" :: held 2.213s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Created reservations ['3159d511-9930-486b-838f-417fc3465d32', 'cef81b7c-a9bc-4c61-a8d3-3ec0433ffcac', 'c44839a1-1541-4a09-b78c-fbfbf45b4fbb', 'fd5706ec-ccb8-4f09-b02d-cb352723885a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Delete snapshot completed successfully. Sep 07 17:02:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-64c02a1f-9cdf-4647-936a-6cd1920ce740 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-920fd347-a04d-4134-a1aa-f81bc891f60b-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Creating offline snapshot e9792c92-7ee6-4967-8f4d-533a25e76d2a of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[908b97ec-a8ef-4e82-8e22-1800036b96a7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:54 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:54 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:54 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.610s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:54 devstack sudo[96917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a 1G Sep 07 17:02:54 devstack sudo[96917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:55 devstack sudo[96917]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a 1G" returned: 0 in 0.728s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:55 devstack sudo[96924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a Sep 07 17:02:55 devstack sudo[96924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:56 devstack sudo[96924]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:56 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a is being set with open permissions: ugo+rw Sep 07 17:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:56 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a Sep 07 17:02:56 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:56 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.324s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:02:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a19c1094-1b65-46b0-956f-21edf71fad13 tempest-SnapshotsActionsTest-1514216551 None] Create snapshot completed successfully Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-e9792c92-7ee6-4967-8f4d-533a25e76d2a-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-e9792c92-7ee6-4967-8f4d-533a25e76d2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-e9792c92-7ee6-4967-8f4d-533a25e76d2a" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-e9792c92-7ee6-4967-8f4d-533a25e76d2a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Deleting offline snapshot e9792c92-7ee6-4967-8f4d-533a25e76d2a of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] snapshot_file for this snap is: volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be0b39a-225b-45bb-8e85-4aa887162170]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:57 devstack sudo[96939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a Sep 07 17:02:57 devstack sudo[96939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:58 devstack sudo[96939]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[12670ee7-a0d7-4db4-a747-a3604e2c6584]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:58 devstack sudo[96944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:02:58 devstack sudo[96944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:58 devstack sudo[96944]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:02:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:58 devstack sudo[96949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a Sep 07 17:02:58 devstack sudo[96949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:59 devstack sudo[96949]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:02:59 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a Sep 07 17:02:59 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:02:59 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.e9792c92-7ee6-4967-8f4d-533a25e76d2a" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-e9792c92-7ee6-4967-8f4d-533a25e76d2a" released by "_delete_snapshot" :: held 1.869s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_snapshot" :: held 1.900s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Created reservations ['16effce7-d56b-460b-af5b-1989fa03d69c', 'f442f3c9-600d-4dd2-bd57-b21b46ae0710', '77ad43d7-2841-487f-80f0-0b7f403ea4aa', 'e4fa13be-64c2-4698-a0bd-ce85293c9934'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:02:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Delete snapshot completed successfully. Sep 07 17:02:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ca28d04-877b-4017-b17b-219703ad8f2e tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-e9792c92-7ee6-4967-8f4d-533a25e76d2a-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Creating offline snapshot da75e43e-aa66-4862-807c-8126cebb544c of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb5d659-adbd-42dd-b294-c5fc7e82296a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:00 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:00 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:00 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:00 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c 1G Sep 07 17:03:00 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c 1G" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:01 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c Sep 07 17:03:01 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c is being set with open permissions: ugo+rw Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:01 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c Sep 07 17:03:01 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:01 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=103,cinder:UPDATE=112,cinder:INSERT=26,cinder:DELETE=2 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:03:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.793s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5b6e05df-787f-4385-acf1-7c649af8a0fb tempest-SnapshotsActionsTest-1514216551 None] Create snapshot completed successfully Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-da75e43e-aa66-4862-807c-8126cebb544c-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-da75e43e-aa66-4862-807c-8126cebb544c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-da75e43e-aa66-4862-807c-8126cebb544c" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-da75e43e-aa66-4862-807c-8126cebb544c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Deleting offline snapshot da75e43e-aa66-4862-807c-8126cebb544c of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] snapshot_file for this snap is: volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6281db39-4543-44be-a979-e9bfd38bca21]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:02 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c Sep 07 17:03:02 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:02 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c" returned: 0 in 0.503s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b83d6a-6dc8-4be8-848f-97a68d809afa]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:03 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:03 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:03 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:03 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c Sep 07 17:03:03 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Flow 'volume_create_manager' (2ed8e4e6-1010-462a-90a3-31aee493876f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c0e97-3aee-43a7-a1c7-8276554725ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec1c0e97-3aee-43a7-a1c7-8276554725ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1497144880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c84852-8e32-4baf-bfba-23d28e55d1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020874715eaa42068f2454406027fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:04Z,use_quota=True,user_id='d4cd036a6b114d7aa5016856ef0d26ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46bd9b8-61f8-4c37-a1ef-494d3a414fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c46bd9b8-61f8-4c37-a1ef-494d3a414fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cedd2e-a7ab-4462-b777-b88a70daf970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9cedd2e-a7ab-4462-b777-b88a70daf970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9c84852-8e32-4baf-bfba-23d28e55d1e2', 'volume_name': 'volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12f98ec-f8c0-494f-b83c-b1366a6a017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b12f98ec-f8c0-494f-b83c-b1366a6a017b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b29225-ed3f-448e-b48a-b30a37512eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Volume f9c84852-8e32-4baf-bfba-23d28e55d1e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2', 'volume_size': 1} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1497144880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9c84852-8e32-4baf-bfba-23d28e55d1e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='020874715eaa42068f2454406027fb71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:04Z,use_quota=True,user_id='d4cd036a6b114d7aa5016856ef0d26ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Creating volume f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:03:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:04 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 1073741824 Sep 07 17:03:04 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:04 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c" returned: 0 in 0.632s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:04 devstack sudo[97019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c Sep 07 17:03:04 devstack sudo[97019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:04 devstack sudo[97019]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.da75e43e-aa66-4862-807c-8126cebb544c" returned: 0 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-da75e43e-aa66-4862-807c-8126cebb544c" released by "_delete_snapshot" :: held 2.120s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_snapshot" :: held 2.146s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:04 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 1073741824" returned: 0 in 0.628s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Created reservations ['6e000c78-6c2d-4b76-8242-3567782e917e', '34ac4208-c732-4ec6-b884-8205c6ac4a9e', 'b2fd22c2-1206-4ad1-ba7b-f3d30ef8c97d', '783a76fc-e69a-4190-b108-d53b207fe64c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:04 devstack sudo[97029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:04 devstack sudo[97029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Delete snapshot completed successfully. Sep 07 17:03:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-adaaddc7-ac52-4b1f-b7a8-376a9afc2c39 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-da75e43e-aa66-4862-807c-8126cebb544c-delete_snapshot" released by "delete_snapshot" :: held 2.492s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:05 devstack sudo[97029]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] <== create_volume: return (1077ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b29225-ed3f-448e-b48a-b30a37512eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb75cc63-575e-4946-bbc9-44e911d017ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Volume volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 (f9c84852-8e32-4baf-bfba-23d28e55d1e2): created successfully Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb75cc63-575e-4946-bbc9-44e911d017ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Flow 'volume_create_manager' (2ed8e4e6-1010-462a-90a3-31aee493876f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-057f663f-118d-4a01-ba5e-355199aa6a9b tempest-TestImageHashVerification-2080968398 None] Created volume successfully. Sep 07 17:03:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-186e192f-86b8-46cd-b906-ffc488f2bee3 req-2d69c909-bb46-499f-aa23-14dceb95548d tempest-AttachVolumeTestJSON-618796532 None] Terminate volume connection completed successfully. Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-186e192f-86b8-46cd-b906-ffc488f2bee3 req-2d69c909-bb46-499f-aa23-14dceb95548d tempest-AttachVolumeTestJSON-618796532 None] Deleting attachment 843b8ad6-b9fb-4cf1-9559-03173173f62a. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Creating offline snapshot 5b025823-9873-497e-adca-645a690b6fc5 of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea289d0e-de9e-4c94-8124-133a6fcab97f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:06 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:06 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:06 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.568s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:06 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 1G Sep 07 17:03:06 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:07 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 1G" returned: 0 in 0.586s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:07 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 Sep 07 17:03:07 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:07 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:07 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 is being set with open permissions: ugo+rw Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:07 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 Sep 07 17:03:07 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:07 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.861s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.126s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a0f40-1784-4f8d-a408-436b408e3a30]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-675e1f43-cf52-42d5-a23f-8e62751690b5 tempest-SnapshotsActionsTest-1514216551 None] Create snapshot completed successfully Sep 07 17:03:07 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:07 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-5b025823-9873-497e-adca-645a690b6fc5-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:08 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-5b025823-9873-497e-adca-645a690b6fc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d51eebb7-c799-4f2c-bfb5-3fe2a9d6ceb1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Acquiring lock "cinder-quobyte-5b025823-9873-497e-adca-645a690b6fc5" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-5b025823-9873-497e-adca-645a690b6fc5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Deleting offline snapshot 5b025823-9873-497e-adca-645a690b6fc5 of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] snapshot_file for this snap is: volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce280253-573d-4abd-9dab-fbabe27dbd21]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:08 devstack sudo[97064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:08 devstack sudo[97064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:08 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 Sep 07 17:03:08 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:08 devstack sudo[97064]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 /opt/stack/data/cinder/conversion/f9c84852-8e32-4baf-bfba-23d28e55d1e2.temp_image.523bfa78-45cc-41b7-a567-583b3a8461a4qllmn9p8.img {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:08 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 /opt/stack/data/cinder/conversion/f9c84852-8e32-4baf-bfba-23d28e55d1e2.temp_image.523bfa78-45cc-41b7-a567-583b3a8461a4qllmn9p8.img Sep 07 17:03:08 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:08 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d53833-b74e-47d3-be60-ce96f8e11c31]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:09 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:09 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:09 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.758s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:09 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 Sep 07 17:03:09 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:09 devstack sudo[97110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:03:09 devstack sudo[97110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:10 devstack sudo[97110]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.641s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:03:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:03:10 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5" returned: 0 in 1.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:11 devstack sudo[97127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5 Sep 07 17:03:11 devstack sudo[97127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:11 devstack sudo[97127]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.5b025823-9873-497e-adca-645a690b6fc5" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-5b025823-9873-497e-adca-645a690b6fc5" released by "_delete_snapshot" :: held 3.250s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_snapshot" :: held 3.324s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Created reservations ['ac9cf3d7-17cd-4df1-b7fe-caf3f3e9a5a6', 'd59f8b33-78f1-463a-a709-3805bd68ab83', 'a73d6b85-b528-466e-8ecb-6c407c9c99ec', 'c9b7a9a4-fc4b-4c5f-b075-46bec7b4e372'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Delete snapshot completed successfully. Sep 07 17:03:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eb0ae83f-2fb3-4752-a6a0-a0bacd5d8b24 tempest-SnapshotsActionsTest-1405035587 None] Lock "cinder-5b025823-9873-497e-adca-645a690b6fc5-delete_snapshot" released by "delete_snapshot" :: held 3.950s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "cinder-197a88fe-f4bf-4e0c-a9ca-ac361a658d05-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-197a88fe-f4bf-4e0c-a9ca-ac361a658d05-delete_snapshot" acquired by "delete_snapshot" :: waited 0.103s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_snapshot" :: waited 0.084s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "cinder-quobyte-197a88fe-f4bf-4e0c-a9ca-ac361a658d05" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-197a88fe-f4bf-4e0c-a9ca-ac361a658d05" acquired by "_delete_snapshot" :: waited 0.075s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Deleting offline snapshot 197a88fe-f4bf-4e0c-a9ca-ac361a658d05 of volume 32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] snapshot_file for this snap is: volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d539cfd0-5651-40b4-8880-7e452c6b264d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:15 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:15 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:15 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 /opt/stack/data/cinder/conversion/f9c84852-8e32-4baf-bfba-23d28e55d1e2.temp_image.523bfa78-45cc-41b7-a567-583b3a8461a4qllmn9p8.img" returned: 0 in 7.084s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[54702e2d-a2c1-4f34-a8f8-0fd9971ecee3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:15 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 1.148s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cfe153-28b4-4c8d-b908-6a576c2c5441]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:16 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:16 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:16 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 Sep 07 17:03:16 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:16 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" returned: 0 in 0.524s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:16 devstack sudo[97223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:16 devstack sudo[97223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:16 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.740s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2, size 1024.00 MB, duration 7.09 sec, destination /opt/stack/data/cinder/conversion/f9c84852-8e32-4baf-bfba-23d28e55d1e2.temp_image.523bfa78-45cc-41b7-a567-583b3a8461a4qllmn9p8.img {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:03:16 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Converted 1024.00 MB image at 144.51 MB/s Sep 07 17:03:16 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] 523bfa78-45cc-41b7-a567-583b3a8461a4 was raw, no need to convert to raw {{(pid=86783) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 17:03:17 devstack sudo[97223]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.560s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:17 devstack sudo[97235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05 Sep 07 17:03:17 devstack sudo[97235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:17 devstack sudo[97235]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973.197a88fe-f4bf-4e0c-a9ca-ac361a658d05" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-197a88fe-f4bf-4e0c-a9ca-ac361a658d05" released by "_delete_snapshot" :: held 2.912s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_snapshot" :: held 2.999s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Created reservations ['d9c6c0c6-af2b-465e-82a9-86a0e176c296', 'b143df03-535b-4c46-856d-d60906cdd5d3', 'e63bebe6-7a4f-4481-8f7c-2517bc5744d4', 'baae06a1-1aeb-46ba-a3dd-445f0e4cd9f5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Delete snapshot completed successfully. Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-89a686f3-f701-48b8-b9cb-e0925384d128 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-197a88fe-f4bf-4e0c-a9ca-ac361a658d05-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "cinder-32cbfa51-cc28-4447-b1db-ec3d1bf9f973-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-32cbfa51-cc28-4447-b1db-ec3d1bf9f973-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8425f7d-b646-41b1-8a8d-5346023d93aa]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:18 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 Sep 07 17:03:18 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:18 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" returned: 0 in 0.505s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:18 devstack sudo[97244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973 Sep 07 17:03:18 devstack sudo[97244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:19 devstack sudo[97244]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-quobyte-32cbfa51-cc28-4447-b1db-ec3d1bf9f973" released by "delete_volume" :: held 1.037s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Created reservations ['f8a456ed-0b9e-4c0b-90ff-0c8a6f62f4f2', '4fc7511d-eb87-4b31-a0c3-e61cda8c1708', 'bf7f63aa-7717-4f1a-8991-30db2c08d4d4', 'dfce1e0c-352f-4761-8a93-f5bf5434dbda'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:19 devstack sudo[97247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:03:19 devstack sudo[97247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:19 devstack sudo[97247]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Deleted volume successfully. Sep 07 17:03:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e8d34b29-7458-4bab-b3c2-693d83222fb1 tempest-SnapshotsActionsTest-1514216551 None] Lock "cinder-32cbfa51-cc28-4447-b1db-ec3d1bf9f973-delete_volume" released by "delete_volume" :: held 1.747s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:29 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:DELETE=2,cinder:UPDATE=29,cinder:SELECT=29,cinder:INSERT=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:03:29 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=55,cinder:UPDATE=56,cinder:INSERT=15,cinder:DELETE=5 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.236s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Uploaded volume to glance image-id: 523bfa78-45cc-41b7-a567-583b3a8461a4. {{(pid=86783) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 17:03:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9dc0daed-c52c-4064-a160-e74a0707aa7a tempest-TestImageHashVerification-2080968398 None] Copy volume to image completed successfully. Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Acquiring lock "cinder-f9c84852-8e32-4baf-bfba-23d28e55d1e2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "cinder-f9c84852-8e32-4baf-bfba-23d28e55d1e2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Acquiring lock "cinder-quobyte-f9c84852-8e32-4baf-bfba-23d28e55d1e2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:03:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "cinder-quobyte-f9c84852-8e32-4baf-bfba-23d28e55d1e2" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:03:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[546e8b5a-6801-4715-a794-e80c17a6466a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:48 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:48 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:48 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:48 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2 Sep 07 17:03:48 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:49 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f9c84852-8e32-4baf-bfba-23d28e55d1e2" returned: 0 in 0.510s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "cinder-quobyte-f9c84852-8e32-4baf-bfba-23d28e55d1e2" released by "delete_volume" :: held 1.091s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Created reservations ['4472c314-0bc2-4f9b-81d3-244b459afede', 'dd3b5159-b42e-4491-9df0-b0b63fce51c1', '435488b5-c9d3-4089-9742-c94695e2f2a6', '05e47bb1-d813-4eef-949c-3401568449ce'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:49 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:03:49 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:49 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:03:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Deleted volume successfully. Sep 07 17:03:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b33710d8-9dfd-43af-bcbc-116797b049f7 tempest-TestImageHashVerification-2080968398 None] Lock "cinder-f9c84852-8e32-4baf-bfba-23d28e55d1e2-delete_volume" released by "delete_volume" :: held 1.698s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Flow 'volume_create_manager' (9cecfdae-04e5-461c-9739-44ac783253d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca332e2a-21c0-4b31-b067-ebbd7d29c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca332e2a-21c0-4b31-b067-ebbd7d29c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1777206579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef88dc1ec84c4910aef56a81cab567f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:56Z,use_quota=True,user_id='847cb1ffd6de41ada9b47f20ceb37e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096ea483-b9f9-4418-aacd-9cc99cf09504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (096ea483-b9f9-4418-aacd-9cc99cf09504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7558deb5-f345-4422-a6df-daec841ebf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:56 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7558deb5-f345-4422-a6df-daec841ebf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647', 'volume_name': 'volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d123dd33-8685-4006-b5f0-1e228aed611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d123dd33-8685-4006-b5f0-1e228aed611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e956d98-3b8d-4f65-9968-f13cc3bdc264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:57 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Trying to clone b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 from image 77b14ba4-a343-4bd3-897b-c62c1df35519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:03:57 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Image download 20.69 MB at 20.69 MB/s Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa055e9-b447-46f5-85d9-1aeadd5a3193]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:58 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD Sep 07 17:03:58 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:58 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD" returned: 0 in 0.565s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:58 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 is fetched for user 847cb1ffd6de41ada9b47f20ceb37e50. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:03:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbb852e-43fd-448e-bb91-35b82f0f9c94]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:03:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:58 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD Sep 07 17:03:58 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:59 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1777206579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef88dc1ec84c4910aef56a81cab567f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:56Z,use_quota=True,user_id='847cb1ffd6de41ada9b47f20ceb37e50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Creating volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:03:59 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (39f46561-5651-4566-95b6-a466d8d26cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9f2959-cfde-4357-be19-f9433707051b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:59 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1073741824 Sep 07 17:03:59 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9f2959-cfde-4357-be19-f9433707051b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973612453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a14fef3-3898-42ce-a32f-50c2e7ae9aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:59Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c32e128-cee1-42ec-a80d-4354adc004aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c32e128-cee1-42ec-a80d-4354adc004aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616ed7f2-aa5e-47f2-a7aa-5957800f31c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (616ed7f2-aa5e-47f2-a7aa-5957800f31c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a14fef3-3898-42ce-a32f-50c2e7ae9aa7', 'volume_name': 'volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642fdbac-3059-4457-9d73-a738acf00b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (642fdbac-3059-4457-9d73-a738acf00b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403d5014-595f-4c5c-9ac1-a60a2c566ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:03:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Volume 0a14fef3-3898-42ce-a32f-50c2e7ae9aa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7', 'volume_size': 1} Sep 07 17:03:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:00 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1073741824" returned: 0 in 1.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:00 devstack sudo[97541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 Sep 07 17:04:00 devstack sudo[97541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:01 devstack sudo[97541]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.387s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:03:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-973612453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a14fef3-3898-42ce-a32f-50c2e7ae9aa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:03:59Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Creating volume 0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:01 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 1073741824 Sep 07 17:04:01 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Attempting download of 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[975e1964-ec06-4312-9960-2d203d7c6b9e]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:01 devstack sudo[97549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p Sep 07 17:04:01 devstack sudo[97549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:02 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 1073741824" returned: 0 in 1.144s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:02 devstack sudo[97549]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p" returned: 0 in 0.759s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:02 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 Sep 07 17:04:02 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:02 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p Sep 07 17:04:02 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:02 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.684s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (403d5014-595f-4c5c-9ac1-a60a2c566ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81719036-5b8e-4dcb-b5a3-9b77d29ae865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:03 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p" returned: 1 in 0.536s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_2mf1wx8p' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c1c0c3-5d64-4f00-9b0a-523412b81ca4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:03 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Volume volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 (0a14fef3-3898-42ce-a32f-50c2e7ae9aa7): created successfully Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81719036-5b8e-4dcb-b5a3-9b77d29ae865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (39f46561-5651-4566-95b6-a466d8d26cb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a3874488-fc65-4807-8762-a2f77e5d240d tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:03 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD Sep 07 17:04:03 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:03 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] 77b14ba4-a343-4bd3-897b-c62c1df35519 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:03 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-513a0f2f-bea9-4ca6-8809-c99ec1b353fb tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" by "attach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:03 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-513a0f2f-bea9-4ca6-8809-c99ec1b353fb tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" acquired by "attach_volume" :: waited 0.052s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-513a0f2f-bea9-4ca6-8809-c99ec1b353fb tempest-VolumesActionsTest-470900873 None] Attaching volume 0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 to instance 3e8a49ed-8386-4d8b-a283-6b51e51375d2 at mountpoint /dev/vdb on host None. Sep 07 17:04:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-513a0f2f-bea9-4ca6-8809-c99ec1b353fb tempest-VolumesActionsTest-470900873 None] Attach volume completed successfully. Sep 07 17:04:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-513a0f2f-bea9-4ca6-8809-c99ec1b353fb tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" released by "attach_volume" :: held 0.504s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Terminate volume connection completed successfully. Sep 07 17:04:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" acquired by "detach_volume" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Detaching volume 0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 from instance 3e8a49ed-8386-4d8b-a283-6b51e51375d2. Sep 07 17:04:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Detach volume completed successfully. Sep 07 17:04:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-02338b88-64da-40d9-8629-9104140677b9 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" released by "detach_volume" :: held 0.234s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-424199a0-664d-462c-b637-c92516ba54cd tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" by "detach_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-424199a0-664d-462c-b637-c92516ba54cd tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-424199a0-664d-462c-b637-c92516ba54cd tempest-VolumesActionsTest-470900873 None] Volume detach called, but volume not attached. Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-424199a0-664d-462c-b637-c92516ba54cd tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-detach_volume" released by "detach_volume" :: held 0.065s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:07 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" returned: 0 in 3.681s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_smcqs85adevstack@QuobyteHD, size 112.00 MB, duration 3.68 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:04:07 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Converted 112.00 MB image at 30.42 MB/s Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:07 devstack sudo[97587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1G Sep 07 17:04:07 devstack sudo[97587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-quobyte-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "cinder-quobyte-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" acquired by "delete_volume" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[14425b94-a276-4364-9027-a5ee59f93a1c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:08 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 Sep 07 17:04:08 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:08 devstack sudo[97587]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 1G" returned: 0 in 0.773s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Downloaded image 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 for user 847cb1ffd6de41ada9b47f20ceb37e50 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Marking volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Copying metadata from image 77b14ba4-a343-4bd3-897b-c62c1df35519 to b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Creating volume glance metadata for volume b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 backed by image 77b14ba4-a343-4bd3-897b-c62c1df35519 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:04:08 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e956d98-3b8d-4f65-9968-f13cc3bdc264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3107cf-6907-46a9-b31c-8991319e64a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" returned: 0 in 0.708s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Volume volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 (b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647): created successfully Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b3107cf-6907-46a9-b31c-8991319e64a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Flow 'volume_create_manager' (9cecfdae-04e5-461c-9739-44ac783253d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:08 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7 Sep 07 17:04:08 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-04b409fd-e377-427f-bc94-c9587417ed53 tempest-VolumesImageMetadata-223770075 None] Created volume successfully. Sep 07 17:04:08 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "cinder-quobyte-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7" released by "delete_volume" :: held 1.197s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Created reservations ['deac0274-3d71-442d-88c0-f79adf09d042', '54930ac6-0395-49ab-9cb2-14fef8e43148', 'f317a9d1-42bb-465e-879f-f6e05891f39b', '6b293090-a40a-4a6a-862d-d20a448f8e4d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:09 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:09 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:09 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.417s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Deleted volume successfully. Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b22dd7d1-cb1a-4dcd-a5fc-03f7bb48a69a tempest-VolumesActionsTest-470900873 None] Lock "cinder-0a14fef3-3898-42ce-a32f-50c2e7ae9aa7-delete_volume" released by "delete_volume" :: held 1.997s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:09 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:09 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:10 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.616s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Acquiring lock "cinder-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "cinder-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Acquiring lock "cinder-quobyte-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "cinder-quobyte-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0013cca2-6551-4b1d-9ce2-329f8c3d95a3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:10 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 Sep 07 17:04:10 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:11 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" returned: 0 in 0.683s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:11 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647 Sep 07 17:04:11 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:11 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" returned: 0 in 0.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "cinder-quobyte-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647" released by "delete_volume" :: held 1.178s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Created reservations ['98403762-cd7a-4418-8257-04cc374c0800', 'd5acdc49-8bb7-4dd6-9046-2952d756612d', '222668f6-bd10-4b94-9289-9f75e44b5ad2', 'a05f1bd4-27da-4bbf-9662-2dcd4f4e81cc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:12 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:12 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:12 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Deleted volume successfully. Sep 07 17:04:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-007cbf06-25c2-4604-8d65-caa25b387ac4 tempest-VolumesImageMetadata-223770075 None] Lock "cinder-b0ad9c9d-3fd2-43f1-8c6a-9706b9d5c647-delete_volume" released by "delete_volume" :: held 1.935s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (e67dfc3a-8992-486e-9f30-47b05284366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaaf89d-6185-4450-b04d-46b17bb85335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7aaaf89d-6185-4450-b04d-46b17bb85335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394384896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fbbcc4-94a9-42f1-9742-1ad03243bd5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:16Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa50aea-0eef-4367-9e64-4809f9c710b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fa50aea-0eef-4367-9e64-4809f9c710b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5012e88-f987-4401-9203-a05e70dbfb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5012e88-f987-4401-9203-a05e70dbfb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2fbbcc4-94a9-42f1-9742-1ad03243bd5f', 'volume_name': 'volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0b6d70-f49e-41a9-8ca9-419195ab47e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e0b6d70-f49e-41a9-8ca9-419195ab47e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3627c8-d599-44bb-9d4c-e7963d3fb7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Volume c2fbbcc4-94a9-42f1-9742-1ad03243bd5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f', 'volume_size': 1} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-394384896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2fbbcc4-94a9-42f1-9742-1ad03243bd5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:16Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Creating volume c2fbbcc4-94a9-42f1-9742-1ad03243bd5f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:15 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:15 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f 1073741824 Sep 07 17:04:15 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:16 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f 1073741824" returned: 0 in 0.520s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:16 devstack sudo[97705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f Sep 07 17:04:16 devstack sudo[97705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:16 devstack sudo[97705]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e3627c8-d599-44bb-9d4c-e7963d3fb7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ded0a16-8da2-45b6-9898-c0f97631d21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Volume volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f (c2fbbcc4-94a9-42f1-9742-1ad03243bd5f): created successfully Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ded0a16-8da2-45b6-9898-c0f97631d21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (e67dfc3a-8992-486e-9f30-47b05284366a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-79a935f1-68e1-44a4-958e-072e90a1c532 tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Flow 'volume_create_manager' (8b0161e0-02e1-4a22-ab07-1353dff8ef23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a157a70-fdd0-4054-9096-929b126f57bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a157a70-fdd0-4054-9096-929b126f57bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2040891335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cae3dc2-c9ce-407f-9821-d78ab6a70f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05b2fd57a1e440cb6ff1dc5e0315168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:18Z,use_quota=True,user_id='cbce0eaf4fbd4c6d8922cb9ab1003991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f31cc4-b66f-45d9-a754-fb0ed182f8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1f31cc4-b66f-45d9-a754-fb0ed182f8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f37c0d5-aa84-4f0a-b527-72735c92f849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f37c0d5-aa84-4f0a-b527-72735c92f849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cae3dc2-c9ce-407f-9821-d78ab6a70f8f', 'volume_name': 'volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5527f09c-9e48-4a68-82f0-08345a22d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5527f09c-9e48-4a68-82f0-08345a22d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2edfbd-edf0-46e7-8c5a-6996b92ccfdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Volume 6cae3dc2-c9ce-407f-9821-d78ab6a70f8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f', 'volume_size': 1} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-2040891335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cae3dc2-c9ce-407f-9821-d78ab6a70f8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b05b2fd57a1e440cb6ff1dc5e0315168',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:18Z,use_quota=True,user_id='cbce0eaf4fbd4c6d8922cb9ab1003991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Creating volume 6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:17 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:17 devstack sudo[97708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f 1073741824 Sep 07 17:04:17 devstack sudo[97708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "cinder-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-quobyte-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[27abbc05-3e2a-4c51-9b4b-79f00fd9f479]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:18 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f Sep 07 17:04:18 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:18 devstack sudo[97708]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f 1073741824" returned: 0 in 0.621s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:18 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" returned: 0 in 0.528s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:18 devstack sudo[97720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f Sep 07 17:04:18 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:18 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f Sep 07 17:04:18 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:18 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa2edfbd-edf0-46e7-8c5a-6996b92ccfdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:18 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e0fa5-d75d-4489-ab58-7146f628c870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Volume volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f (6cae3dc2-c9ce-407f-9821-d78ab6a70f8f): created successfully Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e90e0fa5-d75d-4489-ab58-7146f628c870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Flow 'volume_create_manager' (8b0161e0-02e1-4a22-ab07-1353dff8ef23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f" released by "delete_volume" :: held 0.900s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c54d8c3f-536f-45ee-8083-3d2d42860218 tempest-SnapshotMetadataTestJSON-692943898 None] Created volume successfully. Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Created reservations ['ff3f8f25-3eed-4559-94a9-676d888c7516', 'aaf3b8bf-fc9e-41f2-84f9-07ab6ef19bf3', 'fb435fd5-2aa0-4c80-a213-971de142e73f', '4e5206ee-ee60-486e-b456-0b1892b70dc7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:18 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:18 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:19 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Deleted volume successfully. Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d509d985-4748-4b0e-b9d2-bea0fb68937f tempest-VolumesActionsTest-1251848875 None] Lock "cinder-c2fbbcc4-94a9-42f1-9742-1ad03243bd5f-delete_volume" released by "delete_volume" :: held 1.438s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (eeccd787-bcac-41ce-98ac-575a6a1fa5ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bc95bf-c65e-4f52-9b86-5030d29b55e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2bc95bf-c65e-4f52-9b86-5030d29b55e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827265811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871fa7b9-70c9-413b-8a2c-06446d774951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:20Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4def9-e0a8-43c6-aa5d-6a154e52e927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bc4def9-e0a8-43c6-aa5d-6a154e52e927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27f7afa-2573-4aa6-92f2-e0cc855a02ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e27f7afa-2573-4aa6-92f2-e0cc855a02ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '871fa7b9-70c9-413b-8a2c-06446d774951', 'volume_name': 'volume-871fa7b9-70c9-413b-8a2c-06446d774951', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b594ec-0166-47a3-9094-6d82ec4f94a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b594ec-0166-47a3-9094-6d82ec4f94a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3290507-1975-426a-bc04-9efe1e45800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Volume 871fa7b9-70c9-413b-8a2c-06446d774951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-871fa7b9-70c9-413b-8a2c-06446d774951', 'volume_size': 1} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827265811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=871fa7b9-70c9-413b-8a2c-06446d774951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:20Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Creating volume 871fa7b9-70c9-413b-8a2c-06446d774951 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:19 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 1073741824 Sep 07 17:04:19 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:20 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 1073741824" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:20 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 Sep 07 17:04:20 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:20 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.554s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3290507-1975-426a-bc04-9efe1e45800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-871fa7b9-70c9-413b-8a2c-06446d774951', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268cece-9673-414a-bb50-66b41acf122d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Creating offline snapshot b19ef905-4452-4686-9640-ae6a33206562 of volume 6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:04:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Volume volume-871fa7b9-70c9-413b-8a2c-06446d774951 (871fa7b9-70c9-413b-8a2c-06446d774951): created successfully Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c268cece-9673-414a-bb50-66b41acf122d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (eeccd787-bcac-41ce-98ac-575a6a1fa5ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d26bf-aa9c-42ea-b4b6-44310b7bb855]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-71816445-be76-4683-b23f-1e7bc876c4a4 tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:20 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f Sep 07 17:04:20 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:21 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" returned: 0 in 0.432s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:21 devstack sudo[97750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 1G Sep 07 17:04:21 devstack sudo[97750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:21 devstack sudo[97750]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 1G" returned: 0 in 0.530s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:21 devstack sudo[97756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 Sep 07 17:04:21 devstack sudo[97756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-871fa7b9-70c9-413b-8a2c-06446d774951-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-871fa7b9-70c9-413b-8a2c-06446d774951-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-quobyte-871fa7b9-70c9-413b-8a2c-06446d774951" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-871fa7b9-70c9-413b-8a2c-06446d774951" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffd581-334c-43e3-8a56-e8541cbb5da7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:22 devstack sudo[97756]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:22 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 is being set with open permissions: ugo+rw Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:22 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 Sep 07 17:04:22 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:22 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 Sep 07 17:04:22 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:22 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:22 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info Sep 07 17:04:22 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:22 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951" returned: 0 in 0.670s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:22 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951 Sep 07 17:04:22 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:22 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:22 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info is being set with open permissions: ugo+rw Sep 07 17:04:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:22 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info Sep 07 17:04:22 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:23 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-871fa7b9-70c9-413b-8a2c-06446d774951" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-871fa7b9-70c9-413b-8a2c-06446d774951" released by "delete_volume" :: held 1.035s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Created reservations ['3ea20e76-f0eb-4968-bf84-cbf4c1e81fb6', '09cd37c7-8a54-4b88-ab3b-e8baf930fa9a', '732e2bfa-b61b-4bb0-96e9-5c6ba021211f', '8c73f360-9c7d-416b-98cb-372db0752754'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:23 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.info" returned: 0 in 0.362s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.670s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-67d1f038-b045-4ee8-b22c-fc214fefbbcc tempest-SnapshotMetadataTestJSON-692943898 None] Create snapshot completed successfully Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:23 devstack sudo[97778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:23 devstack sudo[97778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:23 devstack sudo[97778]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Deleted volume successfully. Sep 07 17:04:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e48ef1fd-859e-40ad-8f99-1b361a218a65 tempest-VolumesActionsTest-1251848875 None] Lock "cinder-871fa7b9-70c9-413b-8a2c-06446d774951-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (29763cc6-2ca0-44d2-8176-844fef394b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08340a2-8dd8-4cd7-a5fb-13f6a10d5807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b08340a2-8dd8-4cd7-a5fb-13f6a10d5807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1530970428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb513da-f983-414d-a39d-a18f266df48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:25Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74866a0c-7340-4759-af0d-222324ba5774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74866a0c-7340-4759-af0d-222324ba5774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7671c1f6-507f-4de2-8071-ab4358fe3fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7671c1f6-507f-4de2-8071-ab4358fe3fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bb513da-f983-414d-a39d-a18f266df48d', 'volume_name': 'volume-4bb513da-f983-414d-a39d-a18f266df48d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf29a7b-7de5-4398-9e29-9f1bfd812928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bf29a7b-7de5-4398-9e29-9f1bfd812928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aff34f-119e-4993-8054-7118a68d1f46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Volume 4bb513da-f983-414d-a39d-a18f266df48d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bb513da-f983-414d-a39d-a18f266df48d', 'volume_size': 1} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1530970428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bb513da-f983-414d-a39d-a18f266df48d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:25Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Creating volume 4bb513da-f983-414d-a39d-a18f266df48d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:25 devstack sudo[97782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d 1073741824 Sep 07 17:04:25 devstack sudo[97782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "cinder-b19ef905-4452-4686-9640-ae6a33206562-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-b19ef905-4452-4686-9640-ae6a33206562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "cinder-quobyte-b19ef905-4452-4686-9640-ae6a33206562" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-b19ef905-4452-4686-9640-ae6a33206562" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Deleting offline snapshot b19ef905-4452-4686-9640-ae6a33206562 of volume 6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] snapshot_file for this snap is: volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4201e6bd-9e01-4d57-94f1-b090767c77c6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:25 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 Sep 07 17:04:25 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:25 devstack sudo[97782]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d 1073741824" returned: 0 in 0.668s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:25 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d Sep 07 17:04:25 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:25 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3a400-014c-42b1-a96e-e22b2e4c8e22]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:25 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37aff34f-119e-4993-8054-7118a68d1f46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bb513da-f983-414d-a39d-a18f266df48d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0010fd1-2927-4657-ac63-68ee6c5cf7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:26 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f Sep 07 17:04:26 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Volume volume-4bb513da-f983-414d-a39d-a18f266df48d (4bb513da-f983-414d-a39d-a18f266df48d): created successfully Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0010fd1-2927-4657-ac63-68ee6c5cf7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (29763cc6-2ca0-44d2-8176-844fef394b01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6a7deb88-3381-4bf0-85a8-3d8d270b77a0 tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:26 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:26 devstack sudo[97802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 Sep 07 17:04:26 devstack sudo[97802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:26 devstack sudo[97802]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:26 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562 Sep 07 17:04:26 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:27 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f.b19ef905-4452-4686-9640-ae6a33206562" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-b19ef905-4452-4686-9640-ae6a33206562" released by "_delete_snapshot" :: held 1.792s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" released by "delete_snapshot" :: held 1.839s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-4bb513da-f983-414d-a39d-a18f266df48d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "cinder-4bb513da-f983-414d-a39d-a18f266df48d-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (82757858-3835-44ad-8d75-178879c021a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527579f8-e6da-466b-b0d8-4a0a4b72e213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (527579f8-e6da-466b-b0d8-4a0a4b72e213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1282899093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5845f054-f703-4cd6-ab9e-5884ea651699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:27Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54133cc-3da7-4796-b7f2-f6462ef04fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e54133cc-3da7-4796-b7f2-f6462ef04fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5367f1-1877-4977-89cb-ddb32b8ef9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e5367f1-1877-4977-89cb-ddb32b8ef9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5845f054-f703-4cd6-ab9e-5884ea651699', 'volume_name': 'volume-5845f054-f703-4cd6-ab9e-5884ea651699', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83de28d-1f70-4c9a-a836-3f7ab3785f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a83de28d-1f70-4c9a-a836-3f7ab3785f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb499e0-77b2-463d-aeb2-6235ee985204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Volume 5845f054-f703-4cd6-ab9e-5884ea651699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5845f054-f703-4cd6-ab9e-5884ea651699', 'volume_size': 1} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1282899093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5845f054-f703-4cd6-ab9e-5884ea651699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:27Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Creating volume 5845f054-f703-4cd6-ab9e-5884ea651699 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:27 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 1073741824 Sep 07 17:04:27 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-quobyte-4bb513da-f983-414d-a39d-a18f266df48d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Created reservations ['649d4d2e-413e-461b-bb98-f526a912c66b', '860cb998-3c0f-4816-9c57-5623ee1c6612', '07ce38ef-8552-49fb-a322-ab7a3f457952', '6adf3b11-76df-43f5-9e4e-eb5c15ce7245'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-4bb513da-f983-414d-a39d-a18f266df48d" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[34309da0-e880-44d7-a408-7a5364442594]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Delete snapshot completed successfully. Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c863551-0f26-4cf0-897e-1864e092bce9 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-b19ef905-4452-4686-9640-ae6a33206562-delete_snapshot" released by "delete_snapshot" :: held 2.285s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:27 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d Sep 07 17:04:27 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:27 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 1073741824" returned: 0 in 0.469s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:27 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:27 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 Sep 07 17:04:27 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:27 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d Sep 07 17:04:27 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:28 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fb499e0-77b2-463d-aeb2-6235ee985204) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5845f054-f703-4cd6-ab9e-5884ea651699', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aded3cbb-2ab8-4853-8ef2-a53c095dcf9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:28 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4bb513da-f983-414d-a39d-a18f266df48d" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Volume volume-5845f054-f703-4cd6-ab9e-5884ea651699 (5845f054-f703-4cd6-ab9e-5884ea651699): created successfully Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aded3cbb-2ab8-4853-8ef2-a53c095dcf9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (82757858-3835-44ad-8d75-178879c021a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-4bb513da-f983-414d-a39d-a18f266df48d" released by "delete_volume" :: held 0.766s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e23e0816-03b0-40cb-b8e8-c00e43a00db9 tempest-AttachVolumeTestJSON-618796532 None] Created volume successfully. Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Created reservations ['ef3112e8-8274-4052-8175-2fabd4c68c70', '55590a20-3d3f-4d63-aaf9-6a1a3359c132', 'cf68a391-f07f-4e3f-9f0d-a4d4ea9f120f', '0f7cd4dd-bc10-4fa8-b15b-e8b69a4b30f2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:28 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:28 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "cinder-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:28 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Deleted volume successfully. Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38e4b1f-ba6c-4810-9563-f965559da2cf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0418b92-c1d9-46f8-9595-f7f1069e62ea tempest-VolumesActionsTest-1251848875 None] Lock "cinder-4bb513da-f983-414d-a39d-a18f266df48d-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:28 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f Sep 07 17:04:28 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:29 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:29 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f Sep 07 17:04:29 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:29 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-quobyte-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f" released by "delete_volume" :: held 0.741s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Created reservations ['cecce5c1-fd69-4cb6-8fb2-288d3f11b2aa', '9908f15c-f4f6-4dbf-ad46-8635d3b8f96e', 'd66f50be-6bc3-48ca-8973-bdaea09f5158', '4f355db6-050c-4557-80ad-1b75390889ab'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:29 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:29 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:29 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Deleted volume successfully. Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4826385b-b825-47cd-88d6-8e59d4ee5a70 tempest-SnapshotMetadataTestJSON-692943898 None] Lock "cinder-6cae3dc2-c9ce-407f-9821-d78ab6a70f8f-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (e0c2e164-feae-463f-b5a3-fd1b986161d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c392f0-8c05-492a-8adc-89c76cbe2ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c392f0-8c05-492a-8adc-89c76cbe2ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33986402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00e30f7-2c94-4e9a-aa5c-9f1209be3008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:30Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f07568c-2bb6-4fe5-9ce4-db51c131d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f07568c-2bb6-4fe5-9ce4-db51c131d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728e4df6-ff9c-4c0d-932d-d57776d7c3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728e4df6-ff9c-4c0d-932d-d57776d7c3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00e30f7-2c94-4e9a-aa5c-9f1209be3008', 'volume_name': 'volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b83fd46-8e46-4da9-8df8-092acacc5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b83fd46-8e46-4da9-8df8-092acacc5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ef65d2-e4fb-4dc9-af1a-e4e0f6cd19d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Volume e00e30f7-2c94-4e9a-aa5c-9f1209be3008: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008', 'volume_size': 1} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-33986402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00e30f7-2c94-4e9a-aa5c-9f1209be3008,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:30Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Creating volume e00e30f7-2c94-4e9a-aa5c-9f1209be3008 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ed76c46a-a9a3-4898-8085-b96fef369099 req-d5224dc2-633b-49b4-9655-0779bdb3232e tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:30 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 1073741824 Sep 07 17:04:30 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:30 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 1073741824" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:31 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 Sep 07 17:04:31 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:31 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ed76c46a-a9a3-4898-8085-b96fef369099 req-d5224dc2-633b-49b4-9655-0779bdb3232e tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.934s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-ed76c46a-a9a3-4898-8085-b96fef369099 req-d5224dc2-633b-49b4-9655-0779bdb3232e tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ef65d2-e4fb-4dc9-af1a-e4e0f6cd19d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f4eb9b-c8d1-4fe2-a3f8-227e90a73c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Volume volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 (e00e30f7-2c94-4e9a-aa5c-9f1209be3008): created successfully Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15f4eb9b-c8d1-4fe2-a3f8-227e90a73c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (e0c2e164-feae-463f-b5a3-fd1b986161d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7075e61d-a5b9-463e-b4d7-c0ee619819ac tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ed76c46a-a9a3-4898-8085-b96fef369099 req-d5224dc2-633b-49b4-9655-0779bdb3232e tempest-AttachVolumeTestJSON-618796532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-5845f054-f703-4cd6-ab9e-5884ea651699', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9475c93-422c-4914-8ea3-34110901bfb7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:04:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ed76c46a-a9a3-4898-8085-b96fef369099 req-d5224dc2-633b-49b4-9655-0779bdb3232e tempest-AttachVolumeTestJSON-618796532 None] attachment_update completed successfully. Sep 07 17:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-e00e30f7-2c94-4e9a-aa5c-9f1209be3008-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "cinder-e00e30f7-2c94-4e9a-aa5c-9f1209be3008-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Acquiring lock "cinder-quobyte-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2c7853-098e-40b2-bd81-1e48576ad69b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:33 devstack sudo[98245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 Sep 07 17:04:33 devstack sudo[98245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:33 devstack sudo[98245]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" returned: 0 in 0.580s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:33 devstack sudo[98250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008 Sep 07 17:04:33 devstack sudo[98250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:34 devstack sudo[98250]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" returned: 0 in 0.512s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "cinder-quobyte-e00e30f7-2c94-4e9a-aa5c-9f1209be3008" released by "delete_volume" :: held 1.163s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (e93f3631-7c0b-4169-8f9d-18af3042404f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b920180-b985-48df-ba13-afd29df9bda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b920180-b985-48df-ba13-afd29df9bda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1780405462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbcf409-6825-491d-b364-e6318ce0187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:34Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f80aee-0885-4ed1-b924-1b175b2af7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9f80aee-0885-4ed1-b924-1b175b2af7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bffe59-9a60-47fa-8c67-e7186c83d5bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3bffe59-9a60-47fa-8c67-e7186c83d5bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bbcf409-6825-491d-b364-e6318ce0187f', 'volume_name': 'volume-0bbcf409-6825-491d-b364-e6318ce0187f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb5b62-4531-4114-90f2-3ce3f14229bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfcb5b62-4531-4114-90f2-3ce3f14229bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5e64b8-e280-46c8-8b29-eb7faab88f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Volume 0bbcf409-6825-491d-b364-e6318ce0187f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bbcf409-6825-491d-b364-e6318ce0187f', 'volume_size': 1} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1780405462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bbcf409-6825-491d-b364-e6318ce0187f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b301cf6331b7401397c423df034f3147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:34Z,use_quota=True,user_id='f7aa9aad6f4b4e0692025e2c98d46c5a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Creating volume 0bbcf409-6825-491d-b364-e6318ce0187f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Created reservations ['e9aace6a-c01d-4805-93d9-f37579a8439b', '995756e8-de5a-4e02-8b6c-43d4b91b3695', '405fafd5-dfd7-467e-ba14-bc318bae04e5', 'b877ebd6-0808-4d3a-ad0d-df1ac6951dce'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:34 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f 1073741824 Sep 07 17:04:34 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:34 devstack sudo[98256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:34 devstack sudo[98256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:34 devstack sudo[98256]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Deleted volume successfully. Sep 07 17:04:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a78a7470-f370-4d71-8e0c-14b5b7a432ef tempest-VolumesActionsTest-1251848875 None] Lock "cinder-e00e30f7-2c94-4e9a-aa5c-9f1209be3008-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:35 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f 1073741824" returned: 0 in 0.671s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:35 devstack sudo[98263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f Sep 07 17:04:35 devstack sudo[98263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:35 devstack sudo[98263]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5e64b8-e280-46c8-8b29-eb7faab88f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bbcf409-6825-491d-b364-e6318ce0187f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1ef5f3-f9d3-4a21-83ab-67805b9be375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (483a1dbf-2de9-48b1-9952-d7c287221f8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755dc641-e9ab-4247-8f6d-3dfb8e5df5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (755dc641-e9ab-4247-8f6d-3dfb8e5df5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-387196619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c1f725-dd53-453f-82c8-a9e4b0109b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f8869643744a3d89b415551d058669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:35Z,use_quota=True,user_id='28431b201c8a4167a859facdc66cc7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d3921f-3ce3-44f5-849f-aded1fce9a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34d3921f-3ce3-44f5-849f-aded1fce9a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce82f83-7ea5-401e-ac1d-2fbca3e7e2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce82f83-7ea5-401e-ac1d-2fbca3e7e2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12c1f725-dd53-453f-82c8-a9e4b0109b97', 'volume_name': 'volume-12c1f725-dd53-453f-82c8-a9e4b0109b97', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b2f89-fcd7-4e20-9cf8-9fbd8b8eb72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f6b2f89-fcd7-4e20-9cf8-9fbd8b8eb72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d51960-edb4-4782-ade5-66931b77e9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Volume 12c1f725-dd53-453f-82c8-a9e4b0109b97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12c1f725-dd53-453f-82c8-a9e4b0109b97', 'volume_size': 1} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-387196619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12c1f725-dd53-453f-82c8-a9e4b0109b97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f8869643744a3d89b415551d058669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:35Z,use_quota=True,user_id='28431b201c8a4167a859facdc66cc7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Creating volume 12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Volume volume-0bbcf409-6825-491d-b364-e6318ce0187f (0bbcf409-6825-491d-b364-e6318ce0187f): created successfully Sep 07 17:04:35 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 1073741824 Sep 07 17:04:35 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f1ef5f3-f9d3-4a21-83ab-67805b9be375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Flow 'volume_create_manager' (e93f3631-7c0b-4169-8f9d-18af3042404f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a7cd6485-519d-4e01-ace7-ce327de3d626 tempest-AttachVolumeTestJSON-618796532 None] Created volume successfully. Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (5ee3027e-8cec-4af8-932b-b16bdfb2c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c58d8e7-3930-4348-8e7e-b26446430934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c58d8e7-3930-4348-8e7e-b26446430934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157499486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7b0248-e24b-4a29-b1a1-f7b01de63ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:36Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca90b82-ff58-4d34-a469-16937bc45ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fca90b82-ff58-4d34-a469-16937bc45ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9568088-675f-4317-9aa3-67496352d1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9568088-675f-4317-9aa3-67496352d1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d7b0248-e24b-4a29-b1a1-f7b01de63ddf', 'volume_name': 'volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f613431-e581-4bca-b0a2-db13f8a59087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f613431-e581-4bca-b0a2-db13f8a59087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bced2fd6-c61e-495a-ba71-77c8726c4b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Volume 3d7b0248-e24b-4a29-b1a1-f7b01de63ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf', 'volume_size': 1} Sep 07 17:04:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:36 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 1073741824" returned: 0 in 0.678s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:36 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:36 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:36 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] <== create_volume: return (1264ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.266s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1157499486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d7b0248-e24b-4a29-b1a1-f7b01de63ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c32fc67fe6464b04a8fcde4f478cf5fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:36Z,use_quota=True,user_id='bf96ac8269e848b88cb74e07d9047434',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Creating volume 3d7b0248-e24b-4a29-b1a1-f7b01de63ddf {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:36 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:36 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf 1073741824 Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97d51960-edb4-4782-ade5-66931b77e9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12c1f725-dd53-453f-82c8-a9e4b0109b97', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:36 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3485e63-c5db-4813-8a11-2e4565805461) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Volume volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 (12c1f725-dd53-453f-82c8-a9e4b0109b97): created successfully Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3485e63-c5db-4813-8a11-2e4565805461) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (483a1dbf-2de9-48b1-9952-d7c287221f8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-23eadf99-481d-4f2a-b4ee-bbab67822fc5 tempest-VolumesDeleteCascade-985060373 None] Created volume successfully. Sep 07 17:04:37 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf 1073741824" returned: 0 in 0.698s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:37 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf Sep 07 17:04:37 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f07d59-a536-47d4-9c45-44176c453d55 req-0bdcc5cf-7687-4d4e-959d-bb3fd544e5f9 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:37 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f07d59-a536-47d4-9c45-44176c453d55 req-0bdcc5cf-7687-4d4e-959d-bb3fd544e5f9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.278s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bced2fd6-c61e-495a-ba71-77c8726c4b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c4b90a-3aca-4a51-8b25-e820188cea66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-d2f07d59-a536-47d4-9c45-44176c453d55 req-0bdcc5cf-7687-4d4e-959d-bb3fd544e5f9 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.101s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Volume volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf (3d7b0248-e24b-4a29-b1a1-f7b01de63ddf): created successfully Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c4b90a-3aca-4a51-8b25-e820188cea66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Flow 'volume_create_manager' (5ee3027e-8cec-4af8-932b-b16bdfb2c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Creating offline snapshot 1177f2b9-aefa-477f-b05f-1474cb925376 of volume 12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:04:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d4316a9c-c6c6-44b9-b948-948131471648 tempest-VolumesActionsTest-470900873 None] Created volume successfully. Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[69495b3c-4663-4504-bb61-1c37ef839fc6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-d2f07d59-a536-47d4-9c45-44176c453d55 req-0bdcc5cf-7687-4d4e-959d-bb3fd544e5f9 tempest-AttachVolumeTestJSON-618796532 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-0bbcf409-6825-491d-b364-e6318ce0187f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2822243d-99d4-42bf-8a19-c867d33b41a7', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:04:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-d2f07d59-a536-47d4-9c45-44176c453d55 req-0bdcc5cf-7687-4d4e-959d-bb3fd544e5f9 tempest-AttachVolumeTestJSON-618796532 None] attachment_update completed successfully. Sep 07 17:04:38 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:38 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:38 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:38 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 1G Sep 07 17:04:38 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:38 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 1G" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:38 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:38 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:39 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:39 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 is being set with open permissions: ugo+rw Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:39 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:39 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:39 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=119,cinder:SELECT=107,cinder:INSERT=30,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:39 devstack sudo[98351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info Sep 07 17:04:39 devstack sudo[98351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "cinder-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Acquiring lock "cinder-quobyte-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "cinder-quobyte-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06e38c4-8e4d-45ca-812e-1f4f190bb3ea]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:40 devstack sudo[98351]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:40 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info is being set with open permissions: ugo+rw Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:40 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info Sep 07 17:04:40 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:40 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf Sep 07 17:04:40 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=101,cinder:INSERT=34,cinder:UPDATE=110,cinder:DELETE=12 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Flow 'volume_create_manager' (04a3ddbf-42a4-47f0-9eae-b8baba5e0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:40 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5863432-008c-4ab1-9e1f-9e278cedea91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.info" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.476s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5863432-008c-4ab1-9e1f-9e278cedea91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1356407137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7cf11e-a111-4160-a295-02daf45afdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d388b775a345d7a2d0a4d1f3267336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:40Z,use_quota=True,user_id='c6c3cbb8aa1c4a72bc4618a3670ff33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493a32d7-efdd-4c45-bdb7-cc71e784706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493a32d7-efdd-4c45-bdb7-cc71e784706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbac5b9b-8dc5-4e81-87db-a14fe7af7199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbac5b9b-8dc5-4e81-87db-a14fe7af7199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a7cf11e-a111-4160-a295-02daf45afdc1', 'volume_name': 'volume-3a7cf11e-a111-4160-a295-02daf45afdc1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de5ba81-685e-44cb-8053-8491295a96fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2de5ba81-685e-44cb-8053-8491295a96fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e455b63a-f841-4cc8-8bde-412d7d6d4a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:40 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Volume 3a7cf11e-a111-4160-a295-02daf45afdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a7cf11e-a111-4160-a295-02daf45afdc1', 'volume_size': 1} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1356407137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a7cf11e-a111-4160-a295-02daf45afdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d388b775a345d7a2d0a4d1f3267336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:40Z,use_quota=True,user_id='c6c3cbb8aa1c4a72bc4618a3670ff33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Creating volume 3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" returned: 0 in 0.521s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c796bff8-a63a-4be5-a599-f2dffdd3015f tempest-VolumesDeleteCascade-985060373 None] Create snapshot completed successfully Sep 07 17:04:40 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 1073741824 Sep 07 17:04:40 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:40 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf Sep 07 17:04:40 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:40 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" returned: 0 in 0.333s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "cinder-quobyte-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf" released by "delete_volume" :: held 0.913s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Created reservations ['08c3d19e-6eb2-4806-b2c6-e2f94c16d507', '74cbb5e5-9266-4882-ae74-5f83265cb9ac', '8ff469a3-2aa4-46ec-a56b-ef28f3eb43f7', '961b8639-f954-4a9f-915c-581443ecf275'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a8a6405f-c1e3-41f7-b550-0e7116f8cace req-46823329-1668-4b75-b0e8-d47e4aed306b tempest-AttachVolumeTestJSON-618796532 None] Terminate volume connection completed successfully. Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a8a6405f-c1e3-41f7-b550-0e7116f8cace req-46823329-1668-4b75-b0e8-d47e4aed306b tempest-AttachVolumeTestJSON-618796532 None] Deleting attachment c9475c93-422c-4914-8ea3-34110901bfb7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:41 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:41 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:41 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 1073741824" returned: 0 in 0.655s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:41 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:04:41 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:41 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Deleted volume successfully. Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-22772a25-cfeb-4364-ac53-4c9b90d3d6bd tempest-VolumesActionsTest-470900873 None] Lock "cinder-3d7b0248-e24b-4a29-b1a1-f7b01de63ddf-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:41 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.445s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.312s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e455b63a-f841-4cc8-8bde-412d7d6d4a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a7cf11e-a111-4160-a295-02daf45afdc1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b4364-8402-4f91-a847-12fa3360c579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Creating offline snapshot b55be747-3819-4f59-98a9-d0609ae6dd63 of volume 12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e568fa-53c2-48d4-b67f-fecc8f3e8584]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Volume volume-3a7cf11e-a111-4160-a295-02daf45afdc1 (3a7cf11e-a111-4160-a295-02daf45afdc1): created successfully Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d2b4364-8402-4f91-a847-12fa3360c579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Flow 'volume_create_manager' (04a3ddbf-42a4-47f0-9eae-b8baba5e0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8257111e-5431-448d-806b-a1bf34d63595 tempest-TestStampPattern-418226570 None] Created volume successfully. Sep 07 17:04:41 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:41 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:42 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c1f725-dd53-453f-82c8-a9e4b0109b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:42 devstack sudo[98388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 1G Sep 07 17:04:42 devstack sudo[98388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-392e334e-1a11-4d5f-af97-c98be05baba0 req-5e314ae8-dd83-4861-9a47-e594258a97dc tempest-AttachVolumeTestJSON-618796532 None] Terminate volume connection completed successfully. Sep 07 17:04:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-392e334e-1a11-4d5f-af97-c98be05baba0 req-5e314ae8-dd83-4861-9a47-e594258a97dc tempest-AttachVolumeTestJSON-618796532 None] Deleting attachment 2822243d-99d4-42bf-8a19-c867d33b41a7. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:04:43 devstack sudo[98388]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 1G" returned: 0 in 0.686s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:43 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:43 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:43 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 is being set with open permissions: ugo+rw Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:43 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:43 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:43 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3b359b53-b3ac-4fbf-b55b-b635c24e1bbf tempest-VolumesDeleteCascade-985060373 None] Create snapshot completed successfully Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-12c1f725-dd53-453f-82c8-a9e4b0109b97-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-12c1f725-dd53-453f-82c8-a9e4b0109b97-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Performing cascade delete. {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-1177f2b9-aefa-477f-b05f-1474cb925376-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-1177f2b9-aefa-477f-b05f-1474cb925376-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-1177f2b9-aefa-477f-b05f-1474cb925376" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-1177f2b9-aefa-477f-b05f-1474cb925376" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Deleting offline snapshot 1177f2b9-aefa-477f-b05f-1474cb925376 of volume 12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] snapshot_file for this snap is: volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d71f1b-c6d4-44be-be7c-9459ce97218a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:45 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:45 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:45 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c1f725-dd53-453f-82c8-a9e4b0109b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62710e6b-1ba1-486a-97b7-a45507cd5144]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:45 devstack sudo[98478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:45 devstack sudo[98478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:45 devstack sudo[98478]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5cff19-c32e-4cae-ae98-bb78482f2ead]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:46 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:46 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:46 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.464s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c1f725-dd53-453f-82c8-a9e4b0109b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed03b882-6a1c-4cc4-a1cb-e32fdb8a7568]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:46 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:46 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:46 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c1f725-dd53-453f-82c8-a9e4b0109b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af2a419-fd17-4fae-8adc-e0985dccc9d0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:47 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:47 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:47 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.482s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:47 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:47 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:47 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:47 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376 Sep 07 17:04:47 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:48 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.1177f2b9-aefa-477f-b05f-1474cb925376" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 -F qcow2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:48 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 -F qcow2 Sep 07 17:04:48 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:48 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 -F qcow2" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-1177f2b9-aefa-477f-b05f-1474cb925376" released by "_delete_snapshot" :: held 3.837s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" released by "delete_snapshot" :: held 3.883s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['f849899e-0423-4dc2-87c3-43f08804128c', 'a71a3588-bb43-4517-9135-20208b09c8a8', '385b45b0-36c1-4122-94c1-892275031ea4', '53360c9d-3ef6-4b3e-a2a8-b4f2bead729c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Delete snapshot completed successfully. Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-1177f2b9-aefa-477f-b05f-1474cb925376-delete_snapshot" released by "delete_snapshot" :: held 4.103s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-b55be747-3819-4f59-98a9-d0609ae6dd63-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-b55be747-3819-4f59-98a9-d0609ae6dd63-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-b55be747-3819-4f59-98a9-d0609ae6dd63" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-b55be747-3819-4f59-98a9-d0609ae6dd63" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Deleting offline snapshot b55be747-3819-4f59-98a9-d0609ae6dd63 of volume 12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] snapshot_file for this snap is: volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca5940b-832a-4a26-aec5-51d6d1217104]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:49 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:49 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:50 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.784s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12c1f725-dd53-453f-82c8-a9e4b0109b97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[24670253-d56d-4ef4-8d8f-e7f649c51309]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:50 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:50 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:50 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.618s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:50 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:50 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:51 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:51 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63 Sep 07 17:04:51 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:51 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97.b55be747-3819-4f59-98a9-d0609ae6dd63" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-b55be747-3819-4f59-98a9-d0609ae6dd63" released by "_delete_snapshot" :: held 2.659s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" released by "delete_snapshot" :: held 2.713s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['2aa4db74-736c-4cab-8df7-c51db71b7a42', '0bf5bedd-b21e-43e0-838e-f207b360e3a2', '325274d2-1ea5-4fe2-a14e-955bbb3b3f91', '950e9674-8306-4001-9a68-17e8a460e9be'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Delete snapshot completed successfully. Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-b55be747-3819-4f59-98a9-d0609ae6dd63-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Snapshots deleted, issuing volume delete {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[47655a54-d54c-4e77-bae3-b099509c734e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:52 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:52 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-0bbcf409-6825-491d-b364-e6318ce0187f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-0bbcf409-6825-491d-b364-e6318ce0187f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-quobyte-0bbcf409-6825-491d-b364-e6318ce0187f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-0bbcf409-6825-491d-b364-e6318ce0187f" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd25a5f-8df8-44d5-b08f-36136a1acf6f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:52 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.684s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:52 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97 Sep 07 17:04:52 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:52 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f Sep 07 17:04:52 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:53 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-12c1f725-dd53-453f-82c8-a9e4b0109b97" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-12c1f725-dd53-453f-82c8-a9e4b0109b97" released by "delete_volume" :: held 1.179s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:53 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f" returned: 0 in 0.659s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:53 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f Sep 07 17:04:53 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['b47f7529-86b0-4346-9e62-ab6bd7088292', '30eae9df-fa11-4cd8-bf58-2a075da796fa', '24c33d7d-146f-4487-826e-5872aa5ae376', '220599f7-a8b4-4304-a341-b80187bc4cb7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:53 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:53 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:53 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0bbcf409-6825-491d-b364-e6318ce0187f" returned: 0 in 0.559s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-0bbcf409-6825-491d-b364-e6318ce0187f" released by "delete_volume" :: held 1.314s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:53 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.444s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Deleted volume successfully. Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6b4b71a8-0afb-4f2b-8d78-f428b17a8490 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-12c1f725-dd53-453f-82c8-a9e4b0109b97-delete_volume" released by "delete_volume" :: held 9.258s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Created reservations ['6587dfb4-3196-4c72-a25f-51f8c8006375', '17c38edf-baff-4b89-b9fc-7b9567c6a399', '5c7a2407-667a-43f7-85bd-108596816c0b', 'f2ba9adf-f56c-4f7a-af20-dfdc63fdb8eb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:54 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:54 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:54 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Deleted volume successfully. Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-737e680e-b8cd-4b2f-8722-950d56c48283 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-0bbcf409-6825-491d-b364-e6318ce0187f-delete_volume" released by "delete_volume" :: held 2.144s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-5845f054-f703-4cd6-ab9e-5884ea651699-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-5845f054-f703-4cd6-ab9e-5884ea651699-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-quobyte-5845f054-f703-4cd6-ab9e-5884ea651699" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-5845f054-f703-4cd6-ab9e-5884ea651699" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbd435c-1d6c-4d22-9947-b2f9ca3e69b0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (65fb1448-96d5-400d-aebc-f9ca0c53b1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c791d5-48d5-497a-a851-22a2a86b6d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:55 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 Sep 07 17:04:55 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46c791d5-48d5-497a-a851-22a2a86b6d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-630842751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7598a9e9-22db-44ba-9261-8ac869326e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f8869643744a3d89b415551d058669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:55Z,use_quota=True,user_id='28431b201c8a4167a859facdc66cc7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e78315-6aa8-494a-8bde-8309404576e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4e78315-6aa8-494a-8bde-8309404576e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d629cf-b1ad-4c27-8b38-4b2a9d0197ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79d629cf-b1ad-4c27-8b38-4b2a9d0197ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7598a9e9-22db-44ba-9261-8ac869326e02', 'volume_name': 'volume-7598a9e9-22db-44ba-9261-8ac869326e02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641cdc1d-17e9-4436-9b00-fbb372438eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (641cdc1d-17e9-4436-9b00-fbb372438eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e9cf0-74e3-42b3-b1f3-851f2fb45223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Volume 7598a9e9-22db-44ba-9261-8ac869326e02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7598a9e9-22db-44ba-9261-8ac869326e02', 'volume_size': 1} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-630842751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7598a9e9-22db-44ba-9261-8ac869326e02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f8869643744a3d89b415551d058669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:04:55Z,use_quota=True,user_id='28431b201c8a4167a859facdc66cc7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Creating volume 7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:04:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:55 devstack sudo[98636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 1073741824 Sep 07 17:04:55 devstack sudo[98636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:55 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699" returned: 0 in 0.524s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:55 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699 Sep 07 17:04:55 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:56 devstack sudo[98636]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 1073741824" returned: 0 in 0.697s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:56 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5845f054-f703-4cd6-ab9e-5884ea651699" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-5845f054-f703-4cd6-ab9e-5884ea651699" released by "delete_volume" :: held 1.083s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:56 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:04:56 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Created reservations ['6841b163-8106-47a6-aea6-9fc0aac33221', '6d3c5141-6d81-4619-9871-bb7a780a84f6', 'b3b1cdd1-f62a-49d3-b344-08a7576afa3f', 'ec0db0da-86df-4109-858a-4892063bf1ea'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:56 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:56 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:56 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.571s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c25e9cf0-74e3-42b3-b1f3-851f2fb45223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7598a9e9-22db-44ba-9261-8ac869326e02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:56 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5eb08-fde3-4735-95ff-22620b71c4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Deleted volume successfully. Sep 07 17:04:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Volume volume-7598a9e9-22db-44ba-9261-8ac869326e02 (7598a9e9-22db-44ba-9261-8ac869326e02): created successfully Sep 07 17:04:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02d5eb08-fde3-4735-95ff-22620b71c4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (65fb1448-96d5-400d-aebc-f9ca0c53b1c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:04:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-808fb7d5-dafb-4920-a278-3d520f58953e tempest-VolumesDeleteCascade-985060373 None] Created volume successfully. Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e837b87-6c0a-4f0c-92dc-84af59d9dbef tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-5845f054-f703-4cd6-ab9e-5884ea651699-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Creating offline snapshot 8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe of volume 7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d576f5-3951-4c5d-bb08-7311c84e1aea]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "cinder-quobyte-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[22427871-f210-4fff-ae52-23e68a281a89]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:04:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:57 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:04:57 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:58 devstack sudo[98659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf Sep 07 17:04:58 devstack sudo[98659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:58 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.524s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:58 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe 1G Sep 07 17:04:58 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:58 devstack sudo[98659]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" returned: 0 in 0.717s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:58 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf Sep 07 17:04:58 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:58 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:58 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe 1G" returned: 0 in 0.772s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7598a9e9-22db-44ba-9261-8ac869326e02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-quobyte-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf" released by "delete_volume" :: held 1.201s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:59 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7598a9e9-22db-44ba-9261-8ac869326e02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:04:59 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Created reservations ['8997747f-3ab3-40cf-991f-a694aae67f72', '47dbbd5d-5c60-44ba-9383-6dca33dc50ef', '10e9e981-3ad3-4e1e-9c8d-51569898ac09', '2ab99b84-26c7-4819-b7d4-d80c2eb425d5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:59 devstack sudo[98679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:04:59 devstack sudo[98679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:59 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7598a9e9-22db-44ba-9261-8ac869326e02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:59 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe is being set with open permissions: ugo+rw Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:59 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:04:59 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:04:59 devstack sudo[98679]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:04:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Deleted volume successfully. Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-775c54fe-a286-473c-b00e-da454f069252 tempest-AttachVolumeTestJSON-618796532 None] Lock "cinder-f4e3d018-9e8e-469d-a519-cbd14e9ab0cf-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:04:59 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:04:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:04:59 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info Sep 07 17:04:59 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:00 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:00 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info is being set with open permissions: ugo+rw Sep 07 17:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:00 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info Sep 07 17:05:00 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:00 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.info" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3bcb069f-96e5-4227-a629-75e294f13e20 tempest-VolumesDeleteCascade-985060373 None] Create snapshot completed successfully Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (14d09ea5-6858-4a7d-bd11-45f5027956bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016411cc-35c2-45c3-97a6-de67c5298bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016411cc-35c2-45c3-97a6-de67c5298bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-305730647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cce9fab-474b-4a4c-b818-0c1c80bd53d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7f8869643744a3d89b415551d058669',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:02Z,use_quota=True,user_id='28431b201c8a4167a859facdc66cc7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327f2dd3-5fe4-4358-88d7-333a23ded58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (327f2dd3-5fe4-4358-88d7-333a23ded58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb040d-ca87-4ba1-bf5b-7d3e3555c253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82cb040d-ca87-4ba1-bf5b-7d3e3555c253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8cce9fab-474b-4a4c-b818-0c1c80bd53d6', 'volume_name': 'volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6', 'volume_size': 1, 'snapshot_id': '8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4f37e3-141a-47ef-a67e-3939d9f44954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4f37e3-141a-47ef-a67e-3939d9f44954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db794339-a29a-478d-8004-08643bbc8ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Volume 8cce9fab-474b-4a4c-b818-0c1c80bd53d6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6', 'volume_size': 1, 'snapshot_id': '8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe'} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Creating volume 8cce9fab-474b-4a4c-b818-0c1c80bd53d6 from snapshot 8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] snapshot: 8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe, volume: 8cce9fab-474b-4a4c-b818-0c1c80bd53d6, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a226cc5d-a21c-4e90-8a51-e63e7b24d5e4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:01 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:05:02 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:02 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.671s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7598a9e9-22db-44ba-9261-8ac869326e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[20117228-e3a9-477b-b434-769f92fb8bd5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:02 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:05:02 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:02 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.479s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:05:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:05:03 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:05:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:03 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 Sep 07 17:05:03 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (9a4b9ee3-c634-4205-bf01-58aaf2e66a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e2ed82-ac47-4467-a404-cadfe469ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87e2ed82-ac47-4467-a404-cadfe469ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-306592353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455977b-09d0-44e9-8b4c-312e290133f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:05Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcfe226-89c5-45e4-a2a1-06a4a74cb949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7dcfe226-89c5-45e4-a2a1-06a4a74cb949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c70d7ea-04d9-4b5d-82e6-67c5d0c439ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c70d7ea-04d9-4b5d-82e6-67c5d0c439ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4455977b-09d0-44e9-8b4c-312e290133f5', 'volume_name': 'volume-4455977b-09d0-44e9-8b4c-312e290133f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e889942-0e03-4d25-872b-07371afdc65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e889942-0e03-4d25-872b-07371afdc65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfa6135-06e5-478d-b5d0-44a747a1e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Volume 4455977b-09d0-44e9-8b4c-312e290133f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4455977b-09d0-44e9-8b4c-312e290133f5', 'volume_size': 1} Sep 07 17:05:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:08 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" returned: 0 in 5.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:05:08 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Converted 1024.00 MB image at 188.98 MB/s Sep 07 17:05:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 is being set with open permissions: ugo+rw Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:08 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 Sep 07 17:05:08 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:08 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" released by "_copy_volume_from_snapshot" :: held 6.913s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" released by "_create_volume_from_snapshot" :: held 6.984s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.125s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-306592353',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4455977b-09d0-44e9-8b4c-312e290133f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:05Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Creating volume 4455977b-09d0-44e9-8b4c-312e290133f5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:08 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 1073741824 Sep 07 17:05:08 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db794339-a29a-478d-8004-08643bbc8ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6', 'volume_size': 1, 'snapshot_id': '8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc8c0a6-bc60-4a65-9a41-8733294f21d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Volume volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 (8cce9fab-474b-4a4c-b818-0c1c80bd53d6): created successfully Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fc8c0a6-bc60-4a65-9a41-8733294f21d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Flow 'volume_create_manager' (14d09ea5-6858-4a7d-bd11-45f5027956bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-73495701-d9d8-4cec-8533-f284fcc15db1 tempest-VolumesDeleteCascade-985060373 None] Created volume successfully. Sep 07 17:05:09 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 1073741824" returned: 0 in 0.648s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:09 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 Sep 07 17:05:09 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-7598a9e9-22db-44ba-9261-8ac869326e02-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-7598a9e9-22db-44ba-9261-8ac869326e02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Performing cascade delete. {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:09 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:09 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:09 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebfa6135-06e5-478d-b5d0-44a747a1e67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4455977b-09d0-44e9-8b4c-312e290133f5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5338606a-7a7d-4ae1-85d6-08af1473b1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Volume volume-4455977b-09d0-44e9-8b4c-312e290133f5 (4455977b-09d0-44e9-8b4c-312e290133f5): created successfully Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5338606a-7a7d-4ae1-85d6-08af1473b1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (9a4b9ee3-c634-4205-bf01-58aaf2e66a32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Deleting offline snapshot 8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe of volume 7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] snapshot_file for this snap is: volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:05:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3871ecfd-ecae-4641-b491-869089d1f697 tempest-VolumesListAdminTestJSON-2089724632 None] Created volume successfully. Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffb86df-0630-4fa2-ae53-7c253e1b1e00]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:10 devstack sudo[98766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:05:10 devstack sudo[98766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:10 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:05:10 devstack sudo[98766]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.441s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7598a9e9-22db-44ba-9261-8ac869326e02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a87f935-4e1b-4b69-b5e3-c7e1ae97f32a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:10 devstack sudo[98772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:05:10 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:11 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.664s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:11 devstack sudo[98777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:05:11 devstack sudo[98777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (b3584b78-004e-4892-aaa2-18728683f1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a9780-ad4d-401a-a3f1-79f32bfea567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b5a9780-ad4d-401a-a3f1-79f32bfea567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849190671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a60add-8957-4972-baca-18bae660c0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:11Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd3a423-e37c-439b-889b-57c555ae6369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbd3a423-e37c-439b-889b-57c555ae6369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec94f16f-4393-449e-963e-6a3add5b8ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec94f16f-4393-449e-963e-6a3add5b8ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40a60add-8957-4972-baca-18bae660c0c2', 'volume_name': 'volume-40a60add-8957-4972-baca-18bae660c0c2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c095d18-b2ba-485a-8804-e0f158a19cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c095d18-b2ba-485a-8804-e0f158a19cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd7b9f7-52c7-4494-a294-aa9f9a612b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Volume 40a60add-8957-4972-baca-18bae660c0c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40a60add-8957-4972-baca-18bae660c0c2', 'volume_size': 1} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1849190671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40a60add-8957-4972-baca-18bae660c0c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:11Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Creating volume 40a60add-8957-4972-baca-18bae660c0c2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:11 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 1073741824 Sep 07 17:05:11 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:11 devstack sudo[98777]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:11 devstack sudo[98784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe Sep 07 17:05:11 devstack sudo[98784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:11 devstack sudo[98784]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02.8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe" released by "_delete_snapshot" :: held 1.890s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" released by "delete_snapshot" :: held 1.939s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:11 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 1073741824" returned: 0 in 0.544s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['ae2a8a3b-5aff-418e-b6be-d09b373d7ba1', 'e3ac4aa5-9208-4535-819f-44591c2fe059', 'be41b40f-7fa6-4b24-b0e8-e3c434f5a996', '598b6c0a-df64-4d05-83bd-05944f46be82'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:11 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 Sep 07 17:05:11 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Delete snapshot completed successfully. Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-8ccf8fd6-0511-4a43-9ce8-a521ff4d04fe-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Snapshots deleted, issuing volume delete {{(pid=86783) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 17:05:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f616b9-9f0f-44f5-9b3b-b24d19e924d7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:12 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:12 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:05:12 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bd7b9f7-52c7-4494-a294-aa9f9a612b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40a60add-8957-4972-baca-18bae660c0c2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606c5502-6f50-41bf-990b-9cc5f863e00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Volume volume-40a60add-8957-4972-baca-18bae660c0c2 (40a60add-8957-4972-baca-18bae660c0c2): created successfully Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (606c5502-6f50-41bf-990b-9cc5f863e00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (b3584b78-004e-4892-aaa2-18728683f1b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6d703756-4e20-4ef8-aa56-6113b07cb381 tempest-VolumesListAdminTestJSON-2089724632 None] Created volume successfully. Sep 07 17:05:12 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:12 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02 Sep 07 17:05:12 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:12 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7598a9e9-22db-44ba-9261-8ac869326e02" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-7598a9e9-22db-44ba-9261-8ac869326e02" released by "delete_volume" :: held 0.829s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c804f787-1813-4033-8432-77bec7458c8b req-aa0231dd-ef39-46a4-8dc0-5a05968e44a1 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c804f787-1813-4033-8432-77bec7458c8b req-aa0231dd-ef39-46a4-8dc0-5a05968e44a1 tempest-TestStampPattern-418226570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-c804f787-1813-4033-8432-77bec7458c8b req-aa0231dd-ef39-46a4-8dc0-5a05968e44a1 tempest-TestStampPattern-418226570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-c804f787-1813-4033-8432-77bec7458c8b req-aa0231dd-ef39-46a4-8dc0-5a05968e44a1 tempest-TestStampPattern-418226570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-3a7cf11e-a111-4160-a295-02daf45afdc1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77518829-cc0c-466d-a584-2e4c54bacbee', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:05:12 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['21c8bce3-57a2-4b20-98c9-4289ea31d92a', 'a6af1ec4-cb7b-468a-a548-040a898134d5', '5bd77ca7-6a42-479e-b7d6-0c672274b753', '78308dcc-996f-4f47-872d-df824788a29e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-c804f787-1813-4033-8432-77bec7458c8b req-aa0231dd-ef39-46a4-8dc0-5a05968e44a1 tempest-TestStampPattern-418226570 None] attachment_update completed successfully. Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:13 devstack sudo[98817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:13 devstack sudo[98817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-8cce9fab-474b-4a4c-b818-0c1c80bd53d6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-8cce9fab-474b-4a4c-b818-0c1c80bd53d6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb0d21-8187-4649-a643-501c50db5872]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:13 devstack sudo[98817]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.512s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Deleted volume successfully. Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d931c474-ff91-450e-83f2-8d5c64823053 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-7598a9e9-22db-44ba-9261-8ac869326e02-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:13 devstack sudo[98887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 Sep 07 17:05:13 devstack sudo[98887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:13 devstack sudo[98887]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" returned: 0 in 0.598s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:14 devstack sudo[99209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6 Sep 07 17:05:14 devstack sudo[99209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:14 devstack sudo[99209]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (914ae8cf-9fe8-4102-8d42-456377e7161f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ee0109-7f0e-42cd-be3c-2027427e94e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48ee0109-7f0e-42cd-be3c-2027427e94e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-614032259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631431f-9149-4d2f-9770-1ab0aab8b8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:14Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbb883a-aea8-441b-931b-69981f8f06f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bbb883a-aea8-441b-931b-69981f8f06f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be053b4-4e06-468f-8fe4-2f215a5595d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3be053b4-4e06-468f-8fe4-2f215a5595d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a631431f-9149-4d2f-9770-1ab0aab8b8f3', 'volume_name': 'volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9e56b8-fa46-49f5-a3a6-2d075ad82449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e9e56b8-fa46-49f5-a3a6-2d075ad82449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f594cc89-606f-477f-a447-a1136062346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Volume a631431f-9149-4d2f-9770-1ab0aab8b8f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3', 'volume_size': 1} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-614032259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a631431f-9149-4d2f-9770-1ab0aab8b8f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dbdafdf4ebf4590aba144cc7a181dd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:14Z,use_quota=True,user_id='0429e4a2babb49f08a764d8d83bf4209',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Creating volume a631431f-9149-4d2f-9770-1ab0aab8b8f3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-quobyte-8cce9fab-474b-4a4c-b818-0c1c80bd53d6" released by "delete_volume" :: held 1.098s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:14 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 1073741824 Sep 07 17:05:14 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Created reservations ['7ef8aabd-3d9c-4f72-b534-41ae9a6f6142', 'f893e048-94ac-4719-a451-5590273f7479', '154cf1cc-a727-426b-bfe2-4e251094c2dc', 'bc07f598-30a8-49fb-aadc-59548ceaee33'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:14 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:14 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:14 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Deleted volume successfully. Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c927aa03-d78c-44d7-998f-978534f86680 tempest-VolumesDeleteCascade-985060373 None] Lock "cinder-8cce9fab-474b-4a4c-b818-0c1c80bd53d6-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:14 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 1073741824" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:15 devstack sudo[99227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 Sep 07 17:05:15 devstack sudo[99227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:15 devstack sudo[99227]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f594cc89-606f-477f-a447-a1136062346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce90ffc-1fc2-49be-a5f7-e21d6c5bf090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Volume volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 (a631431f-9149-4d2f-9770-1ab0aab8b8f3): created successfully Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce90ffc-1fc2-49be-a5f7-e21d6c5bf090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Flow 'volume_create_manager' (914ae8cf-9fe8-4102-8d42-456377e7161f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9cd3dae8-6d61-4a09-af69-c44f2a81b80f tempest-VolumesListAdminTestJSON-2089724632 None] Created volume successfully. Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Flow 'volume_create_manager' (dbabc7d1-51d1-44f0-9664-0863009b97dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe89371f-5493-4380-b9c6-170b125808b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe89371f-5493-4380-b9c6-170b125808b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb7bbe-3f63-49b3-9c84-d628e6dea96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecfc43830fa74c4caf8864e2498b3d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:17Z,use_quota=True,user_id='5d6b068f282e4464bd4d2722dfd64f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a7e8a-ce6c-4da7-a6bd-5809ca45cf89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542a7e8a-ce6c-4da7-a6bd-5809ca45cf89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0fad3-2804-4ffc-9585-a224513bbe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee0fad3-2804-4ffc-9585-a224513bbe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11cb7bbe-3f63-49b3-9c84-d628e6dea96b', 'volume_name': 'volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b481e0-974a-47fa-af92-ca44f6492b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0b481e0-974a-47fa-af92-ca44f6492b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cc2468-f644-4269-bd09-133d82a33aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Volume 11cb7bbe-3f63-49b3-9c84-d628e6dea96b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b', 'volume_size': 1} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11cb7bbe-3f63-49b3-9c84-d628e6dea96b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ecfc43830fa74c4caf8864e2498b3d84',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:17Z,use_quota=True,user_id='5d6b068f282e4464bd4d2722dfd64f9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Creating volume 11cb7bbe-3f63-49b3-9c84-d628e6dea96b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:17 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:17 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b 1073741824 Sep 07 17:05:17 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-13835ec1-f960-49d2-80f9-4fd6803e1441 tempest-GroupsV314Test-1862193662 None] Group tempest-GroupsV314Test-Group-653932080: creating Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-13835ec1-f960-49d2-80f9-4fd6803e1441 tempest-GroupsV314Test-1862193662 None] Group tempest-GroupsV314Test-Group-653932080: created successfully Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-13835ec1-f960-49d2-80f9-4fd6803e1441 tempest-GroupsV314Test-1862193662 None] Create group completed successfully. Sep 07 17:05:18 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b 1073741824" returned: 0 in 0.635s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:18 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b Sep 07 17:05:18 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:18 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16cc2468-f644-4269-bd09-133d82a33aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2432cdd-c5b1-4bbc-9b00-d95e55f611be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Volume volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b (11cb7bbe-3f63-49b3-9c84-d628e6dea96b): created successfully Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2432cdd-c5b1-4bbc-9b00-d95e55f611be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Flow 'volume_create_manager' (dbabc7d1-51d1-44f0-9664-0863009b97dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-51bc02a0-c38c-4803-b446-daec4686a5d8 tempest-VolumesListAdminTestJSON-353622647 None] Created volume successfully. Sep 07 17:05:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-25e26b34-79b3-4492-a57d-ae19b91d6ead req-40aebc89-223a-4cda-a0c9-40acb18e9a78 tempest-TestStampPattern-418226570 None] Terminate volume connection completed successfully. Sep 07 17:05:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-25e26b34-79b3-4492-a57d-ae19b91d6ead req-40aebc89-223a-4cda-a0c9-40acb18e9a78 tempest-TestStampPattern-418226570 None] Deleting attachment 77518829-cc0c-466d-a584-2e4c54bacbee. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Acquiring lock "cinder-11cb7bbe-3f63-49b3-9c84-d628e6dea96b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "cinder-11cb7bbe-3f63-49b3-9c84-d628e6dea96b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Acquiring lock "cinder-quobyte-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Flow 'volume_create_manager' (9591789e-23e3-4509-9675-9d13979b7f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a4fc8-80ca-4bfb-86ff-462a2117504e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (737a4fc8-80ca-4bfb-86ff-462a2117504e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-924054983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f0a2f45-1360-479e-8d5c-74ae9dd79349,host='devstack@QuobyteHD#QuobyteHD',id=b588d2fe-675e-49c7-99ed-074b60618bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ba217b787b43dbb412632aeab2f411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:20Z,use_quota=True,user_id='b3fb5b376ff74f7990270220bf131824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a86959de-91c3-4a1f-b1aa-2ece00826858),volume_type_id=a86959de-91c3-4a1f-b1aa-2ece00826858)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95fc1ba-8e27-42ed-89f4-8d93b572e6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d95fc1ba-8e27-42ed-89f4-8d93b572e6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6986ee9-01c0-4fa7-ad87-ea098ed57a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6986ee9-01c0-4fa7-ad87-ea098ed57a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b588d2fe-675e-49c7-99ed-074b60618bc2', 'volume_name': 'volume-b588d2fe-675e-49c7-99ed-074b60618bc2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d39b5e-c9cb-449e-8157-4c12c3cc81df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4d39b5e-c9cb-449e-8157-4c12c3cc81df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46197cd2-13e8-4192-bc18-73f2a5abd87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Volume b588d2fe-675e-49c7-99ed-074b60618bc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b588d2fe-675e-49c7-99ed-074b60618bc2', 'volume_size': 1} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f0a2f45-1360-479e-8d5c-74ae9dd79349,created_at=2026-09-07T15:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-924054983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f0a2f45-1360-479e-8d5c-74ae9dd79349,host='devstack@QuobyteHD#QuobyteHD',id=b588d2fe-675e-49c7-99ed-074b60618bc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63ba217b787b43dbb412632aeab2f411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:20Z,use_quota=True,user_id='b3fb5b376ff74f7990270220bf131824',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a86959de-91c3-4a1f-b1aa-2ece00826858),volume_type_id=a86959de-91c3-4a1f-b1aa-2ece00826858)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Creating volume b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "cinder-quobyte-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" acquired by "delete_volume" :: waited 0.180s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:19 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 1073741824 Sep 07 17:05:19 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-a631431f-9149-4d2f-9770-1ab0aab8b8f3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7cfd0e-727f-4a17-acb8-a8ba4830ee28]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-a631431f-9149-4d2f-9770-1ab0aab8b8f3-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-quobyte-a631431f-9149-4d2f-9770-1ab0aab8b8f3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-a631431f-9149-4d2f-9770-1ab0aab8b8f3" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20417d3-90fc-466f-a945-643e1072a70f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack sudo[99294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b Sep 07 17:05:20 devstack sudo[99294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:20 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 Sep 07 17:05:20 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:20 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 1073741824" returned: 0 in 0.543s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack sudo[99294]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" returned: 0 in 0.475s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack sudo[99305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b Sep 07 17:05:20 devstack sudo[99305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack sudo[99309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:20 devstack sudo[99309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:20 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack sudo[99312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3 Sep 07 17:05:20 devstack sudo[99312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:20 devstack sudo[99305]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "cinder-quobyte-11cb7bbe-3f63-49b3-9c84-d628e6dea96b" released by "delete_volume" :: held 0.856s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:20 devstack sudo[99309]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.804s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46197cd2-13e8-4192-bc18-73f2a5abd87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b588d2fe-675e-49c7-99ed-074b60618bc2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda84db-810b-4643-9d10-1f1c4dee3bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Creating offline snapshot 02627460-e356-425f-bfd5-e341044e82c6 of volume 3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:05:20 devstack sudo[99312]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a631431f-9149-4d2f-9770-1ab0aab8b8f3" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de55bd8-5bc5-401c-9276-83fe3a375f91]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Volume volume-b588d2fe-675e-49c7-99ed-074b60618bc2 (b588d2fe-675e-49c7-99ed-074b60618bc2): created successfully Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beda84db-810b-4643-9d10-1f1c4dee3bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Flow 'volume_create_manager' (9591789e-23e3-4509-9675-9d13979b7f6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Created reservations ['2cd6aaea-7c74-4007-b403-e9db2b0d09ab', '8e3ee784-1c33-498c-ab43-da30e0ab4908', '2a73f502-e325-4655-a831-4a5fa40225e6', '7a5fccd2-e557-40bc-8937-d2d9a0bb8ca9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-a631431f-9149-4d2f-9770-1ab0aab8b8f3" released by "delete_volume" :: held 0.853s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-be02652a-47de-4d41-b4e3-506954f68264 tempest-GroupsV314Test-1862193662 None] Created volume successfully. Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:21 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:05:21 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Created reservations ['17113143-aa01-45d7-8df8-fdbe1856eee8', '43e26424-25a0-43dd-b9a2-412fd89daaba', 'a33af382-10e1-41d9-8c95-018a02540423', 'd2efbd4a-e4ef-41a4-9d1d-0c8fcfc1dd25'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:21 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:21 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:21 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:21 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:21 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Deleted volume successfully. Sep 07 17:05:21 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.507s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e114c52b-b043-4055-8a8c-56cfb14b3c27 tempest-VolumesListAdminTestJSON-353622647 None] Lock "cinder-11cb7bbe-3f63-49b3-9c84-d628e6dea96b-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:21 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 1G Sep 07 17:05:21 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:21 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Deleted volume successfully. Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0d53a38a-3187-47ab-9896-878da5fca177 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-a631431f-9149-4d2f-9770-1ab0aab8b8f3-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:21 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 1G" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7cf11e-a111-4160-a295-02daf45afdc1 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:21 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7cf11e-a111-4160-a295-02daf45afdc1 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:05:21 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:22 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a7cf11e-a111-4160-a295-02daf45afdc1 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:22 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 is being set with open permissions: ugo+rw Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:22 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:05:22 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Flow 'volume_create_manager' (d281161e-45a8-4b93-bb82-7c7a23b78680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecaa718-de19-4a41-99bc-d1782a2b6784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-40a60add-8957-4972-baca-18bae660c0c2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ecaa718-de19-4a41-99bc-d1782a2b6784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1802684792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b363ff8-b690-497e-b468-df4984560bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e888812ba342318bc09b1f4b630812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:22Z,use_quota=True,user_id='0ca00824f9584715960fe84eae6bba5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041f6531-1f86-414f-9344-9068ef4bb9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041f6531-1f86-414f-9344-9068ef4bb9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bced4e-00c6-441d-884a-21464feb320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2bced4e-00c6-441d-884a-21464feb320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b363ff8-b690-497e-b468-df4984560bcf', 'volume_name': 'volume-7b363ff8-b690-497e-b468-df4984560bcf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39869d40-e628-4181-815d-a556685cb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39869d40-e628-4181-815d-a556685cb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc12492-979a-4c05-8b68-3492cf25c64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Volume 7b363ff8-b690-497e-b468-df4984560bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b363ff8-b690-497e-b468-df4984560bcf', 'volume_size': 1} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-40a60add-8957-4972-baca-18bae660c0c2-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:22 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-quobyte-40a60add-8957-4972-baca-18bae660c0c2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-40a60add-8957-4972-baca-18bae660c0c2" acquired by "delete_volume" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:22 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info Sep 07 17:05:22 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c363fd2a-4b7b-488e-86ac-1733a2d3ce9b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:22 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 Sep 07 17:05:22 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:22 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info" returned: 0 in 0.280s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:22 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info is being set with open permissions: ugo+rw Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:22 devstack sudo[99347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info Sep 07 17:05:22 devstack sudo[99347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:22 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:22 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2 Sep 07 17:05:22 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:23 devstack sudo[99347]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.info" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.242s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1802684792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b363ff8-b690-497e-b468-df4984560bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e888812ba342318bc09b1f4b630812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:22Z,use_quota=True,user_id='0ca00824f9584715960fe84eae6bba5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Creating volume 7b363ff8-b690-497e-b468-df4984560bcf {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:23 devstack sudo[99355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf 1073741824 Sep 07 17:05:23 devstack sudo[99355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d789035a-32e7-49c6-93aa-6bfa381dbfc0 tempest-TestStampPattern-418226570 None] Create snapshot completed successfully Sep 07 17:05:23 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-40a60add-8957-4972-baca-18bae660c0c2" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-40a60add-8957-4972-baca-18bae660c0c2" released by "delete_volume" :: held 0.720s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Created reservations ['aad4b9fb-ab6a-4b32-a1d1-e000b3acdce6', 'c626586c-6c28-4b48-9cc9-71b7b68d28da', 'a8e0e7e7-8485-4bd0-9e71-5e52b9392ebd', 'c8fb3cca-c4da-4061-8854-524bfacb0619'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:23 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:23 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-4455977b-09d0-44e9-8b4c-312e290133f5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:23 devstack sudo[99355]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf 1073741824" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-4455977b-09d0-44e9-8b4c-312e290133f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "cinder-quobyte-4455977b-09d0-44e9-8b4c-312e290133f5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:23 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf Sep 07 17:05:23 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:23 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-4455977b-09d0-44e9-8b4c-312e290133f5" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Deleted volume successfully. Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e572b2ae-8574-4517-87fa-b86c679dd6bd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-435415b2-516b-4aa0-8f8b-db8809a56f42 tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-40a60add-8957-4972-baca-18bae660c0c2-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:23 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 Sep 07 17:05:23 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:23 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.937s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Cloning volume b588d2fe-675e-49c7-99ed-074b60618bc2 to volume 6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc12492-979a-4c05-8b68-3492cf25c64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b363ff8-b690-497e-b468-df4984560bcf', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a28d8e-3c88-4d92-8696-7a3be53f22a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Volume volume-7b363ff8-b690-497e-b468-df4984560bcf (7b363ff8-b690-497e-b468-df4984560bcf): created successfully Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a28d8e-3c88-4d92-8696-7a3be53f22a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Flow 'volume_create_manager' (d281161e-45a8-4b93-bb82-7c7a23b78680) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Creating offline snapshot 2234852b-816b-4449-b4c4-a97844921827 of volume b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:05:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d6a78d2e-bab2-49aa-b5a4-d1e96421ba94 tempest-VolumesTransfersTest-635736591 None] Created volume successfully. Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cfaf9d3-9c6b-4a6a-b75d-1a6d2568f54c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:24 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:24 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:24 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:24 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5 Sep 07 17:05:24 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:24 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4455977b-09d0-44e9-8b4c-312e290133f5" returned: 0 in 0.308s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:24 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-quobyte-4455977b-09d0-44e9-8b4c-312e290133f5" released by "delete_volume" :: held 0.782s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:24 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 1G Sep 07 17:05:24 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Created reservations ['3a51ff66-c787-4996-8859-bf2732f5eff0', '9792d120-0b76-4b4f-b501-c4d485fe0763', 'adad9d35-58d2-4fca-94dc-1681fb71d066', '857ae048-8087-45a5-ae78-eee2647ebf80'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:24 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:24 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:24 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Deleted volume successfully. Sep 07 17:05:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-61024334-0b59-43ed-bad0-8707ed7350ac tempest-VolumesListAdminTestJSON-2089724632 None] Lock "cinder-4455977b-09d0-44e9-8b4c-312e290133f5-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:25 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 1G" returned: 0 in 0.592s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b588d2fe-675e-49c7-99ed-074b60618bc2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:25 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b588d2fe-675e-49c7-99ed-074b60618bc2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:25 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9ad9c1f0-4430-4aaa-b5a1-3cd1267de20d tempest-VolumesTransfersTest-848799904 None] Transfer volume completed successfully. Sep 07 17:05:25 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b588d2fe-675e-49c7-99ed-074b60618bc2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:25 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:25 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:25 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:25 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:25 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info Sep 07 17:05:25 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:26 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:26 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:26 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info Sep 07 17:05:26 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Acquiring lock "cinder-7b363ff8-b690-497e-b468-df4984560bcf-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "cinder-7b363ff8-b690-497e-b468-df4984560bcf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Acquiring lock "cinder-quobyte-7b363ff8-b690-497e-b468-df4984560bcf" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "cinder-quobyte-7b363ff8-b690-497e-b468-df4984560bcf" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5d4b45-07b8-40f9-b65a-ab74a2c17007]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:26 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.info" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Acquiring lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] snapshot: 2234852b-816b-4449-b4c4-a97844921827, volume: 6f1cda44-d58f-4a97-bccb-cbbdeb0c0127, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:05:26 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf Sep 07 17:05:26 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcea30f-b2f5-47af-a855-7e1c31583a50]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:26 devstack sudo[99419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:26 devstack sudo[99419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:26 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf" returned: 0 in 0.560s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:27 devstack sudo[99434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf Sep 07 17:05:27 devstack sudo[99434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:27 devstack sudo[99419]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.551s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b588d2fe-675e-49c7-99ed-074b60618bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde93d29-4b66-45a5-af70-325adca103f2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:27 devstack sudo[99434]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7b363ff8-b690-497e-b468-df4984560bcf" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "cinder-quobyte-7b363ff8-b690-497e-b468-df4984560bcf" released by "delete_volume" :: held 0.919s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:27 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:27 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Created reservations ['16a3cb13-11f7-4dd4-a86c-c9752650b144', '001e6fbe-d709-4ec7-a3d5-20d982520c3b', '59e9be21-61d5-429c-a4df-a6beacd538f8', '8618b057-aafb-4261-b333-dcf4438540ec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:27 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:27 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:27 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 0.647s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:05:27 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Deleted volume successfully. Sep 07 17:05:27 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 Sep 07 17:05:27 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ec1c9ea2-e7c3-4f14-89eb-61a8075f2fb5 tempest-VolumesTransfersTest-598151728 None] Lock "cinder-7b363ff8-b690-497e-b468-df4984560bcf-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Flow 'volume_create_manager' (ef61fe1e-3a54-4470-939f-351fe6420aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fda3a0-c0a0-461f-bd3d-025184014cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fda3a0-c0a0-461f-bd3d-025184014cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-959882556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbce62d-9592-4c9d-9f4e-2d0a5771eb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e888812ba342318bc09b1f4b630812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:28Z,use_quota=True,user_id='0ca00824f9584715960fe84eae6bba5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de26076-a838-4358-89d8-72a9137e0a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3de26076-a838-4358-89d8-72a9137e0a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94fb01c-c99d-4a8d-ab89-4a2950c8db48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94fb01c-c99d-4a8d-ab89-4a2950c8db48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bbce62d-9592-4c9d-9f4e-2d0a5771eb35', 'volume_name': 'volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac802b4-ce1a-4770-a2eb-3c6d8cfbb971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aac802b4-ce1a-4770-a2eb-3c6d8cfbb971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b9b19d-5014-4073-9417-da317042b5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Volume 3bbce62d-9592-4c9d-9f4e-2d0a5771eb35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35', 'volume_size': 1} Sep 07 17:05:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:33 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" returned: 0 in 5.419s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:05:33 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Converted 1024.00 MB image at 188.92 MB/s Sep 07 17:05:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:33 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 Sep 07 17:05:33 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:33 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" released by "_copy_volume_from_snapshot" :: held 7.013s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Acquiring lock "cinder-quobyte-2234852b-816b-4449-b4c4-a97844921827" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-2234852b-816b-4449-b4c4-a97844921827" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Deleting offline snapshot 2234852b-816b-4449-b4c4-a97844921827 of volume b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] snapshot_file for this snap is: volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccbdf7a-0ea0-4478-80bb-b5fdd4bbf462]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:33 devstack sudo[99474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:33 devstack sudo[99474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:34 devstack sudo[99474]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b588d2fe-675e-49c7-99ed-074b60618bc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccae6647-ab15-4abb-bda1-c5ce5ba68e3c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:34 devstack sudo[99480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:34 devstack sudo[99480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:34 devstack sudo[99480]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 0.579s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:34 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:34 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:35 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:35 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827 Sep 07 17:05:35 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:35 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2.2234852b-816b-4449-b4c4-a97844921827" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-2234852b-816b-4449-b4c4-a97844921827" released by "_delete_snapshot" :: held 1.825s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.649s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.194s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-959882556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bbce62d-9592-4c9d-9f4e-2d0a5771eb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48e888812ba342318bc09b1f4b630812',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:28Z,use_quota=True,user_id='0ca00824f9584715960fe84eae6bba5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Creating volume 3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:35 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 1073741824 Sep 07 17:05:35 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3e265a29-c0a1-4044-9ab7-ba422e55fe3e tempest-GroupsV314Test-1862193662 None] Create group from source-group-7f0a2f45-1360-479e-8d5c-74ae9dd79349 completed successfully. Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Flow 'volume_create_manager' (59a05a2e-123d-4a8f-8658-c58f44261e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d3db20-effc-47db-98e5-4848a1108b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76d3db20-effc-47db-98e5-4848a1108b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2064424530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d573e5d6-525e-4947-840c-b071aa025294,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d388b775a345d7a2d0a4d1f3267336',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=02627460-e356-425f-bfd5-e341044e82c6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:36Z,use_quota=True,user_id='c6c3cbb8aa1c4a72bc4618a3670ff33a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0425a4-96f7-432d-a465-1e25f55fff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d0425a4-96f7-432d-a465-1e25f55fff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ccba83-7892-4109-bba7-9837f5c07289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8ccba83-7892-4109-bba7-9837f5c07289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd573e5d6-525e-4947-840c-b071aa025294', 'volume_name': 'volume-d573e5d6-525e-4947-840c-b071aa025294', 'volume_size': 1, 'snapshot_id': '02627460-e356-425f-bfd5-e341044e82c6'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964e34de-5f64-45da-a739-7892a860fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964e34de-5f64-45da-a739-7892a860fb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab9da5b-ff09-4732-a635-0bc9daaf7a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Volume d573e5d6-525e-4947-840c-b071aa025294: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d573e5d6-525e-4947-840c-b071aa025294', 'volume_size': 1, 'snapshot_id': '02627460-e356-425f-bfd5-e341044e82c6'} Sep 07 17:05:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:36 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 1073741824" returned: 0 in 0.634s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:36 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 Sep 07 17:05:36 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Acquiring lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:36 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3a763b-48a9-44b7-98a8-8d3f72f49663]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.611s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6-d573e5d6-525e-4947-840c-b071aa025294" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6-d573e5d6-525e-4947-840c-b071aa025294" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Creating volume d573e5d6-525e-4947-840c-b071aa025294 from snapshot 02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95b9b19d-5014-4073-9417-da317042b5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdf6db6-3f19-4b62-9181-cfdb862c0453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" acquired by "_copy_volume_from_snapshot" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] snapshot: 02627460-e356-425f-bfd5-e341044e82c6, volume: d573e5d6-525e-4947-840c-b071aa025294, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:05:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Volume volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 (3bbce62d-9592-4c9d-9f4e-2d0a5771eb35): created successfully Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afdf6db6-3f19-4b62-9181-cfdb862c0453) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Flow 'volume_create_manager' (ef61fe1e-3a54-4470-939f-351fe6420aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:36 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 Sep 07 17:05:36 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4c2059eb-06a1-43a1-82ab-01675409ab15 tempest-VolumesTransfersTest-635736591 None] Created volume successfully. Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a700c0b-138a-45ce-8276-22b99075d441]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:36 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:05:36 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:37 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" returned: 0 in 0.525s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:37 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127 Sep 07 17:05:37 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:37 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.605s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7cf11e-a111-4160-a295-02daf45afdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3047393b-d423-44df-8862-2b88c699dbd8]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:37 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:05:37 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Flow 'volume_create_manager' (df26011e-8f8c-48f6-a175-d1bff4c13920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18418fee-cb65-42a3-9cce-307db57515ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18418fee-cb65-42a3-9cce-307db57515ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-443061304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88372714-8f4a-4373-8588-a5bfc7c7df12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9269ba4ebb6f4641a181012ef03c1da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:37Z,use_quota=True,user_id='ab8008f25c2845baafee0e564133cd9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0198139-616e-4d16-ac54-7f81ebe1fb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0198139-616e-4d16-ac54-7f81ebe1fb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:37 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd6f7e0-809b-40aa-ba12-fc390f7b91b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd6f7e0-809b-40aa-ba12-fc390f7b91b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88372714-8f4a-4373-8588-a5bfc7c7df12', 'volume_name': 'volume-88372714-8f4a-4373-8588-a5bfc7c7df12', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc94cb88-d71c-4f5c-a4dc-299dbe68ee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc94cb88-d71c-4f5c-a4dc-299dbe68ee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b8a996-1789-4eb4-905c-90f08c13d0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Volume 88372714-8f4a-4373-8588-a5bfc7c7df12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88372714-8f4a-4373-8588-a5bfc7c7df12', 'volume_size': 1} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" returned: 0 in 0.693s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-6f1cda44-d58f-4a97-bccb-cbbdeb0c0127" released by "delete_volume" :: held 1.289s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Acquiring lock "cinder-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "cinder-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Created reservations ['9f89b9a8-e35d-4c11-9695-1b0e64fb77d4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:37 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.532s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:37 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 Sep 07 17:05:37 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Acquiring lock "cinder-quobyte-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:38 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1549781345 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1549781345, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:05:38 devstack cinder-volume[86783]: WARNING cinder.quota [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1549781345 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1549781345, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "cinder-quobyte-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5ea512-7075-41d5-acd8-6a1ed9390fd1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Created reservations ['40d0b382-abe5-4ee6-aab8-1bfc1efb05d2', 'dda18c9b-64f5-4a6d-84f1-0fd2303a64dd', 'fd76b425-40de-4693-8484-fb9afb0b789c', 'cebeaa7f-d01b-45e6-bba9-3bb0820df6cc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:38 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 Sep 07 17:05:38 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:38 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:38 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:38 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f7a90a89-328e-46f3-aea0-51e1ac3b418b tempest-GroupsV314Test-1862193662 None] Delete group completed successfully. Sep 07 17:05:38 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" returned: 0 in 0.647s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:38 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35 Sep 07 17:05:38 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:39 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" returned: 0 in 0.649s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "cinder-quobyte-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35" released by "delete_volume" :: held 1.405s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Created reservations ['9be1f4ba-9eb8-48e9-82e7-fcb8ad70ee5a', '23c90f13-9292-44e5-9e13-e579a9bef09d', 'b626167d-52b8-40bc-8618-ed340af06885', '970dc6fd-2b64-482f-8f6b-cb8debce4f0b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=142,cinder:UPDATE=177,cinder:DELETE=13,cinder:INSERT=39 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:39 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:39 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Acquiring lock "cinder-quobyte-b588d2fe-675e-49c7-99ed-074b60618bc2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-b588d2fe-675e-49c7-99ed-074b60618bc2" acquired by "delete_volume" :: waited 0.059s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2012c9-7b63-453f-8872-98a98aa1b37a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:40 devstack sudo[99590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:40 devstack sudo[99590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:40 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 1.103s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:40 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Deleted volume successfully. Sep 07 17:05:41 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=141,cinder:INSERT=44,cinder:UPDATE=168,cinder:DELETE=14 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:05:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0172150d-94ee-41fd-8611-12f5f1113fee tempest-VolumesTransfersTest-598151728 None] Lock "cinder-3bbce62d-9592-4c9d-9f4e-2d0a5771eb35-delete_volume" released by "delete_volume" :: held 3.206s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:41 devstack sudo[99590]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 1.467s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:41 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2 Sep 07 17:05:41 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:42 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b588d2fe-675e-49c7-99ed-074b60618bc2" returned: 0 in 0.585s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Lock "cinder-quobyte-b588d2fe-675e-49c7-99ed-074b60618bc2" released by "delete_volume" :: held 2.316s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Created reservations ['67baa8bc-4952-452b-b167-d67637f2f826'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Created reservations ['c95f6259-5913-407b-be6c-6cfa1da9c32f', '4a7c8fff-ec8f-4267-a94d-827df0330fc0', '29d8dd46-5741-4525-8500-82dd25cf74fb', '15dfdb78-8806-475a-9d52-c0b79c08ed4c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:43 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:43 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:43 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.583s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b93ff19d-3263-4dd6-9ec1-afcd96275550 tempest-GroupsV314Test-1862193662 None] Delete group completed successfully. Sep 07 17:05:45 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294" returned: 0 in 7.675s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:45 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1, size 1024.00 MB, duration 7.68 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:05:45 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Converted 1024.00 MB image at 133.35 MB/s Sep 07 17:05:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 is being set with open permissions: ugo+rw Sep 07 17:05:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:45 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 Sep 07 17:05:45 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:46 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" released by "_copy_volume_from_snapshot" :: held 9.478s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6-d573e5d6-525e-4947-840c-b071aa025294" released by "_create_volume_from_snapshot" :: held 9.625s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.663s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.481s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-443061304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88372714-8f4a-4373-8588-a5bfc7c7df12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9269ba4ebb6f4641a181012ef03c1da2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:37Z,use_quota=True,user_id='ab8008f25c2845baafee0e564133cd9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Creating volume 88372714-8f4a-4373-8588-a5bfc7c7df12 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:05:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:46 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 1073741824 Sep 07 17:05:46 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ab9da5b-ff09-4732-a635-0bc9daaf7a07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d573e5d6-525e-4947-840c-b071aa025294', 'volume_size': 1, 'snapshot_id': '02627460-e356-425f-bfd5-e341044e82c6'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720f7e19-9a3c-4a5b-94a8-1d8807c93f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Volume volume-d573e5d6-525e-4947-840c-b071aa025294 (d573e5d6-525e-4947-840c-b071aa025294): created successfully Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720f7e19-9a3c-4a5b-94a8-1d8807c93f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Flow 'volume_create_manager' (59a05a2e-123d-4a8f-8658-c58f44261e78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-332da93d-01a7-47bd-87d0-641c635788fb tempest-TestStampPattern-418226570 None] Created volume successfully. Sep 07 17:05:47 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 1073741824" returned: 0 in 0.778s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:47 devstack sudo[99638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 Sep 07 17:05:47 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:47 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b8a996-1789-4eb4-905c-90f08c13d0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88372714-8f4a-4373-8588-a5bfc7c7df12', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf697d3c-afda-4613-ab3e-4550ff8274da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Volume volume-88372714-8f4a-4373-8588-a5bfc7c7df12 (88372714-8f4a-4373-8588-a5bfc7c7df12): created successfully Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf697d3c-afda-4613-ab3e-4550ff8274da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Flow 'volume_create_manager' (df26011e-8f8c-48f6-a175-d1bff4c13920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7339e230-7487-447c-9756-14e8f20db9de tempest-VolumesMetadataTest-60443252 None] Created volume successfully. Sep 07 17:05:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Acquiring lock "cinder-88372714-8f4a-4373-8588-a5bfc7c7df12-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "cinder-88372714-8f4a-4373-8588-a5bfc7c7df12-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Acquiring lock "cinder-quobyte-88372714-8f4a-4373-8588-a5bfc7c7df12" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:05:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "cinder-quobyte-88372714-8f4a-4373-8588-a5bfc7c7df12" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:05:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e50a880-e231-4405-8652-6b468eb26e0e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:50 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 Sep 07 17:05:50 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:51 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12" returned: 0 in 0.891s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:51 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12 Sep 07 17:05:51 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:51 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88372714-8f4a-4373-8588-a5bfc7c7df12" returned: 0 in 0.564s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "cinder-quobyte-88372714-8f4a-4373-8588-a5bfc7c7df12" released by "delete_volume" :: held 1.552s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Created reservations ['0a92a0b5-e722-43f1-9f22-e9efa12af058', '70fb60f3-a2fb-4f06-99dd-737617f3d40a', '1e7d5e51-d6aa-4390-95b8-b9376f2ae1ec', '07550e56-3382-441e-8f88-dfc41667a517'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:05:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:51 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:05:51 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:52 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:52 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:05:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Deleted volume successfully. Sep 07 17:05:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7eba67c8-a304-4f81-bcc8-59c66f88a80d tempest-VolumesMetadataTest-60443252 None] Lock "cinder-88372714-8f4a-4373-8588-a5bfc7c7df12-delete_volume" released by "delete_volume" :: held 2.283s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Flow 'volume_create_manager' (745ff38c-1818-449b-a8c5-46be66bc6ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12918b59-a723-4dba-a1c4-27b6895479d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12918b59-a723-4dba-a1c4-27b6895479d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2007119494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702cdd47-34f3-4216-8f8e-aae7679b245b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a805ccb5c44588cac397203cfece9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:57Z,use_quota=True,user_id='3eee36a787d742f084a77c9ea88f3b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffaf7499-332f-4775-809c-2b1618433c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffaf7499-332f-4775-809c-2b1618433c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1e1fa8-56a6-422f-9e76-8192e88e8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:57 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:05:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f1e1fa8-56a6-422f-9e76-8192e88e8c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '702cdd47-34f3-4216-8f8e-aae7679b245b', 'volume_name': 'volume-702cdd47-34f3-4216-8f8e-aae7679b245b', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c92016e-689c-4bb6-a72f-d5e2684881c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c92016e-689c-4bb6-a72f-d5e2684881c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:05:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f609e-7300-4998-ae97-c551d5104c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:05:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Volume 702cdd47-34f3-4216-8f8e-aae7679b245b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-702cdd47-34f3-4216-8f8e-aae7679b245b', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 17:05:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Trying to clone 702cdd47-34f3-4216-8f8e-aae7679b245b from image 77b14ba4-a343-4bd3-897b-c62c1df35519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:05:59 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Image download 20.69 MB at 20.69 MB/s Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae91e17e-2c40-4158-ab35-46f97c5d6eff]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:05:59 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD Sep 07 17:05:59 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:05:59 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 is fetched for user 3eee36a787d742f084a77c9ea88f3b8d. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d1bbae-231b-440e-94ab-b5460da65cfb]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:05:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:00 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD Sep 07 17:06:00 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:00 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2007119494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702cdd47-34f3-4216-8f8e-aae7679b245b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a805ccb5c44588cac397203cfece9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:05:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:05:57Z,use_quota=True,user_id='3eee36a787d742f084a77c9ea88f3b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Creating volume 702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:00 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:00 devstack sudo[99714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1073741824 Sep 07 17:06:00 devstack sudo[99714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:01 devstack sudo[99714]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1073741824" returned: 0 in 0.696s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:01 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b Sep 07 17:06:01 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Flow 'volume_create_manager' (a92b49ce-2373-415d-8031-728064472396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c510b7c0-e6dd-4e93-b01d-b77a0b0cf7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c510b7c0-e6dd-4e93-b01d-b77a0b0cf7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1611271435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aec47fba4954bd581e48e047cacb520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:01Z,use_quota=True,user_id='be95c726b4574dee86dd35c9188796a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47eaec3-ca7c-474f-965c-fa86fce03c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d47eaec3-ca7c-474f-965c-fa86fce03c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a99661-21d7-4ca4-98f3-6053eb3ee285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67a99661-21d7-4ca4-98f3-6053eb3ee285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d', 'volume_name': 'volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1f5424-bfe6-47f0-a447-2baa9b16ae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de1f5424-bfe6-47f0-a447-2baa9b16ae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce275b-6061-4722-8bff-5413ffa4caeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Volume 0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d', 'volume_size': 1} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:01 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.034s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1611271435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aec47fba4954bd581e48e047cacb520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:01Z,use_quota=True,user_id='be95c726b4574dee86dd35c9188796a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Creating volume 0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:01 devstack sudo[99723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d 1073741824 Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Attempting download of 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 702cdd47-34f3-4216-8f8e-aae7679b245b. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:06:01 devstack sudo[99723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf03efd2-9a06-4e09-94e8-9b525a818b30]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:01 devstack sudo[99725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa Sep 07 17:06:01 devstack sudo[99725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:02 devstack sudo[99725]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:02 devstack sudo[99723]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d 1073741824" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:02 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa Sep 07 17:06:02 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:02 devstack sudo[99742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d Sep 07 17:06:02 devstack sudo[99742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:02 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:02 devstack sudo[99742]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa" returned: 1 in 0.492s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_76kvy7aa' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb97b394-ddb0-4a25-938e-2f85f207a656]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adce275b-6061-4722-8bff-5413ffa4caeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f9823-bf7f-49fd-a88a-17e8e2560d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Volume volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d (0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d): created successfully Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (196f9823-bf7f-49fd-a88a-17e8e2560d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Flow 'volume_create_manager' (a92b49ce-2373-415d-8031-728064472396) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-03a14664-0ad3-4ba3-a6a6-6de1caa36838 tempest-VolumesTransfersV357Test-1711322361 None] Created volume successfully. Sep 07 17:06:02 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD Sep 07 17:06:02 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:03 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:03 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] 77b14ba4-a343-4bd3-897b-c62c1df35519 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:06:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:03 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b Sep 07 17:06:03 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-19f5a69b-e7bd-4193-99fe-877656ef6105 tempest-VolumesTransfersV357Test-728933333 None] Transfer volume completed successfully. Sep 07 17:06:05 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b" returned: 0 in 2.100s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_ehdwvo1hdevstack@QuobyteHD, size 112.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:06:05 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Converted 112.00 MB image at 53.32 MB/s Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:05 devstack sudo[99762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1G Sep 07 17:06:05 devstack sudo[99762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "cinder-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "cinder-quobyte-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:05 devstack sudo[99762]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 1G" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Downloaded image 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 702cdd47-34f3-4216-8f8e-aae7679b245b successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 for user 3eee36a787d742f084a77c9ea88f3b8d is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Marking volume 702cdd47-34f3-4216-8f8e-aae7679b245b as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-quobyte-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Copying metadata from image 77b14ba4-a343-4bd3-897b-c62c1df35519 to 702cdd47-34f3-4216-8f8e-aae7679b245b. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Creating volume glance metadata for volume 702cdd47-34f3-4216-8f8e-aae7679b245b backed by image 77b14ba4-a343-4bd3-897b-c62c1df35519 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[274cbcc3-3f01-4df9-a2f4-c8ae4621659d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (785f609e-7300-4998-ae97-c551d5104c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702cdd47-34f3-4216-8f8e-aae7679b245b', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6417092-6b2f-4de2-b011-d02d7c169be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Volume volume-702cdd47-34f3-4216-8f8e-aae7679b245b (702cdd47-34f3-4216-8f8e-aae7679b245b): created successfully Sep 07 17:06:05 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6417092-6b2f-4de2-b011-d02d7c169be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:05 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Flow 'volume_create_manager' (745ff38c-1818-449b-a8c5-46be66bc6ecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e8e6dd7-f24b-42d8-97ae-3b880cf80bb7 tempest-VolumesExtendTest-1890362956 None] Created volume successfully. Sep 07 17:06:05 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:05 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d Sep 07 17:06:05 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62fc2c78-c66a-4388-8eb3-e6229cff90b6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:06 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-quobyte-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d" released by "delete_volume" :: held 0.717s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:06 devstack sudo[99778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b Sep 07 17:06:06 devstack sudo[99778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Created reservations ['013ae019-8a43-4955-be79-7149dd25e562', '64b7ff81-9f3d-4971-bfaf-68f24ded323c', 'e60f83a6-e7d3-4aa8-9081-4f32155bf709', '37e239f3-e240-4fc5-9cda-fdebc8d89221'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:06 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:06 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:06 devstack sudo[99778]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b" returned: 0 in 0.486s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:06 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.296s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b 2G" returned: 0 in 0.120s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.643s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Deleted volume successfully. Sep 07 17:06:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16f8082c-2ef7-420e-87cf-39c6d3d4ff61 tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-0560e1a0-c1c0-4c1f-bcbb-5cf97d5ede1d-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6cc3104-db18-43ab-9406-720fc3953b06 tempest-VolumesExtendTest-1890362956 None] Extend volume completed successfully. Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Flow 'volume_create_manager' (e4f2508a-e942-409b-9154-124de02fc050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840925ca-f921-4887-9ed5-9a844ca25304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (840925ca-f921-4887-9ed5-9a844ca25304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-831597445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865278f6-82f6-4697-96bc-fb5527b442b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aec47fba4954bd581e48e047cacb520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:07Z,use_quota=True,user_id='be95c726b4574dee86dd35c9188796a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed421ad-8a7e-4bdb-868b-2c5581098764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bed421ad-8a7e-4bdb-868b-2c5581098764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c219fe-60e1-46d0-bedf-58fbcfb76a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c219fe-60e1-46d0-bedf-58fbcfb76a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '865278f6-82f6-4697-96bc-fb5527b442b3', 'volume_name': 'volume-865278f6-82f6-4697-96bc-fb5527b442b3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f5da3-5e08-4366-bea4-2cf68add23fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72f5da3-5e08-4366-bea4-2cf68add23fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac720f-aecd-4e10-9fe5-af78944533d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Volume 865278f6-82f6-4697-96bc-fb5527b442b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-865278f6-82f6-4697-96bc-fb5527b442b3', 'volume_size': 1} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-831597445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=865278f6-82f6-4697-96bc-fb5527b442b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8aec47fba4954bd581e48e047cacb520',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:07Z,use_quota=True,user_id='be95c726b4574dee86dd35c9188796a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Creating volume 865278f6-82f6-4697-96bc-fb5527b442b3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:07 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 1073741824 Sep 07 17:06:07 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Flow 'volume_create_manager' (268b032d-b187-40f6-8eed-cdf25f79cc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30977f5-105f-4826-979b-012758a47b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e30977f5-105f-4826-979b-012758a47b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1846722398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38176275-47e8-484b-a82e-7f8de0d04c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a142807f47d643109987168d3d2bf26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:07Z,use_quota=True,user_id='56b4800538c54336b72e5747e0c4ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e989e9b-2d01-4e4b-a440-f76ea6f0a3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e989e9b-2d01-4e4b-a440-f76ea6f0a3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a825591b-5bd6-45db-8d45-4dc4ecb4c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a825591b-5bd6-45db-8d45-4dc4ecb4c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38176275-47e8-484b-a82e-7f8de0d04c25', 'volume_name': 'volume-38176275-47e8-484b-a82e-7f8de0d04c25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcb6cc-da6a-4249-8661-10a31ef16eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bcb6cc-da6a-4249-8661-10a31ef16eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e12fe6-1da5-4c53-afd3-d0cdf4bcc6a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume 38176275-47e8-484b-a82e-7f8de0d04c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38176275-47e8-484b-a82e-7f8de0d04c25', 'volume_size': 1} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-702cdd47-34f3-4216-8f8e-aae7679b245b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-702cdd47-34f3-4216-8f8e-aae7679b245b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-quobyte-702cdd47-34f3-4216-8f8e-aae7679b245b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-702cdd47-34f3-4216-8f8e-aae7679b245b" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46cc5c6-e0b6-4bd8-925e-36315eb14318]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:07 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b Sep 07 17:06:07 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:07 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 1073741824" returned: 0 in 0.455s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:08 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 Sep 07 17:06:08 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:08 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:08 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b Sep 07 17:06:08 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:08 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.650s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1846722398',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38176275-47e8-484b-a82e-7f8de0d04c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a142807f47d643109987168d3d2bf26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:07Z,use_quota=True,user_id='56b4800538c54336b72e5747e0c4ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Creating volume 38176275-47e8-484b-a82e-7f8de0d04c25 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dac720f-aecd-4e10-9fe5-af78944533d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-865278f6-82f6-4697-96bc-fb5527b442b3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a18bde-9c29-4712-b818-558a46c975d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:08 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 1073741824 Sep 07 17:06:08 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Volume volume-865278f6-82f6-4697-96bc-fb5527b442b3 (865278f6-82f6-4697-96bc-fb5527b442b3): created successfully Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70a18bde-9c29-4712-b818-558a46c975d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Flow 'volume_create_manager' (e4f2508a-e942-409b-9154-124de02fc050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a922a943-44b3-48ca-b5e5-7ad576f36348 tempest-VolumesTransfersV357Test-1711322361 None] Created volume successfully. Sep 07 17:06:08 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-702cdd47-34f3-4216-8f8e-aae7679b245b" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-702cdd47-34f3-4216-8f8e-aae7679b245b" released by "delete_volume" :: held 0.703s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Created reservations ['8f1a0f79-4c4f-460b-877a-69be90d04ad5', '0b11a152-53b9-4e00-91e9-7216d29660f4', '9fd634df-3053-402b-a293-3c3de88348fc', '3f8045f2-15aa-483e-a6ab-d5889486b12d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:08 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:08 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:08 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 1073741824" returned: 0 in 0.496s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:08 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Deleted volume successfully. Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fac93a0c-006f-4e91-ba84-1b2899bb4635 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-702cdd47-34f3-4216-8f8e-aae7679b245b-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:08 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 Sep 07 17:06:08 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:09 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1e12fe6-1da5-4c53-afd3-d0cdf4bcc6a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38176275-47e8-484b-a82e-7f8de0d04c25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60fcfbe-4859-4ef3-93d0-df4de9bc51ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume volume-38176275-47e8-484b-a82e-7f8de0d04c25 (38176275-47e8-484b-a82e-7f8de0d04c25): created successfully Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a60fcfbe-4859-4ef3-93d0-df4de9bc51ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Flow 'volume_create_manager' (268b032d-b187-40f6-8eed-cdf25f79cc97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7fd545d2-bbd4-4c8e-80fd-bb9b92997b7a tempest-VolumeQuotasAdminTestJSON-1194163895 None] Created volume successfully. Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Flow 'volume_create_manager' (3f36df2a-3b08-4fec-b508-6c8117bae375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b11687-bbe1-4a77-a8e5-a2debac55d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b11687-bbe1-4a77-a8e5-a2debac55d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1930036248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d286b-87a3-4e38-bdd2-b1cb9b5b70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a805ccb5c44588cac397203cfece9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:09Z,use_quota=True,user_id='3eee36a787d742f084a77c9ea88f3b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43b4976-abc3-4e85-815d-bca5ca056708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e43b4976-abc3-4e85-815d-bca5ca056708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122a7591-8408-4f89-94e5-1835912a737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (122a7591-8408-4f89-94e5-1835912a737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635d286b-87a3-4e38-bdd2-b1cb9b5b70fb', 'volume_name': 'volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5fb6b0-a85f-4093-a8ba-5e944168655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e5fb6b0-a85f-4093-a8ba-5e944168655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebbd021-fe10-4d78-85bd-55c35bf8c6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Volume 635d286b-87a3-4e38-bdd2-b1cb9b5b70fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb', 'volume_size': 1} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1930036248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d286b-87a3-4e38-bdd2-b1cb9b5b70fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb1a805ccb5c44588cac397203cfece9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:09Z,use_quota=True,user_id='3eee36a787d742f084a77c9ea88f3b8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Creating volume 635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:09 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "cinder-38176275-47e8-484b-a82e-7f8de0d04c25-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:09 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb 1073741824 Sep 07 17:06:09 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "cinder-38176275-47e8-484b-a82e-7f8de0d04c25-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "cinder-quobyte-38176275-47e8-484b-a82e-7f8de0d04c25" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "cinder-quobyte-38176275-47e8-484b-a82e-7f8de0d04c25" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[936f8e2c-db4d-474f-ad9b-a2abf22abfc9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "cinder-865278f6-82f6-4697-96bc-fb5527b442b3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-865278f6-82f6-4697-96bc-fb5527b442b3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:09 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 Sep 07 17:06:09 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "cinder-quobyte-865278f6-82f6-4697-96bc-fb5527b442b3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-quobyte-865278f6-82f6-4697-96bc-fb5527b442b3" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b27dec-7429-492a-ad0a-3fdde5c3d9cd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:09 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:09 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:09 devstack sudo[99829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 Sep 07 17:06:09 devstack sudo[99829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:09 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb 1073741824" returned: 0 in 0.542s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:10 devstack sudo[99838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25 Sep 07 17:06:10 devstack sudo[99838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:10 devstack sudo[99839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:10 devstack sudo[99839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:10 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:06:10 devstack sudo[99829]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3" returned: 0 in 0.470s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:10 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3 Sep 07 17:06:10 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:10 devstack sudo[99838]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38176275-47e8-484b-a82e-7f8de0d04c25" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack sudo[99839]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "cinder-quobyte-38176275-47e8-484b-a82e-7f8de0d04c25" released by "delete_volume" :: held 0.769s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ebbd021-fe10-4d78-85bd-55c35bf8c6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47fd0e8-29dc-4ac4-9035-fd8a3887cdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Volume volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb (635d286b-87a3-4e38-bdd2-b1cb9b5b70fb): created successfully Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47fd0e8-29dc-4ac4-9035-fd8a3887cdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Flow 'volume_create_manager' (3f36df2a-3b08-4fec-b508-6c8117bae375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bd99dc83-b745-4d5b-a767-d8bf3e4f11bc tempest-VolumesExtendTest-1890362956 None] Created volume successfully. Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Created reservations ['2eda8bbc-71b2-4d0a-b60c-a54d7790c014', 'd958fa27-f574-4e9b-a86d-54bfac5be730', '2043e750-f927-4140-83e7-6d1e9c96c6f9', '21f3519c-e4e9-4112-809a-893d152ab746'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:10 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:10 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-865278f6-82f6-4697-96bc-fb5527b442b3" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-quobyte-865278f6-82f6-4697-96bc-fb5527b442b3" released by "delete_volume" :: held 0.793s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Created reservations ['4832edc4-4e38-493d-b15f-9177c10ef311', '2d62530c-84b8-495c-8745-5719c4e637eb', '20cdcf6c-efe8-42e9-850f-36b8e3b86db2', 'c644859f-651c-4544-9189-34de808aab17'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:10 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:10 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:10 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Deleted volume successfully. Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f50e4250-d090-417f-a741-d90c02fc68ed tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "cinder-38176275-47e8-484b-a82e-7f8de0d04c25-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:10 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Deleted volume successfully. Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-41f6f6b3-ffab-448c-ab33-797d6b65fbad tempest-VolumesTransfersV357Test-944557210 None] Lock "cinder-865278f6-82f6-4697-96bc-fb5527b442b3-delete_volume" released by "delete_volume" :: held 1.356s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Flow 'volume_create_manager' (53b8e8b7-78d3-479e-9dcb-7028797517e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c23dcb7-74a9-45ff-a9a4-b934a810072a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c23dcb7-74a9-45ff-a9a4-b934a810072a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1607835286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0954efcc-58d3-42d8-a344-51d0017b7ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a142807f47d643109987168d3d2bf26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:11Z,use_quota=True,user_id='56b4800538c54336b72e5747e0c4ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8917f30e-bbf7-42ef-af21-75248d83eecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8917f30e-bbf7-42ef-af21-75248d83eecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602bb32-44c6-4933-baa4-80dfd43325a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e602bb32-44c6-4933-baa4-80dfd43325a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0954efcc-58d3-42d8-a344-51d0017b7ee5', 'volume_name': 'volume-0954efcc-58d3-42d8-a344-51d0017b7ee5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b91c40e-876b-4ea3-9b72-edcf43457793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b91c40e-876b-4ea3-9b72-edcf43457793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bf7e8-d468-47a1-9923-437e1249669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume 0954efcc-58d3-42d8-a344-51d0017b7ee5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0954efcc-58d3-42d8-a344-51d0017b7ee5', 'volume_size': 1} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1607835286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0954efcc-58d3-42d8-a344-51d0017b7ee5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a142807f47d643109987168d3d2bf26a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:11Z,use_quota=True,user_id='56b4800538c54336b72e5747e0c4ac4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Creating volume 0954efcc-58d3-42d8-a344-51d0017b7ee5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:11 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 1073741824 Sep 07 17:06:11 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:11 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 1073741824" returned: 0 in 0.472s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:11 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 Sep 07 17:06:11 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:12 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.472s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (052bf7e8-d468-47a1-9923-437e1249669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0954efcc-58d3-42d8-a344-51d0017b7ee5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df359679-5847-4beb-bc81-c1e69a748e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Creating offline snapshot 48ae85fe-c70a-4632-abc7-559fdeda9cbf of volume 635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:06:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Volume volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 (0954efcc-58d3-42d8-a344-51d0017b7ee5): created successfully Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df359679-5847-4beb-bc81-c1e69a748e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Flow 'volume_create_manager' (53b8e8b7-78d3-479e-9dcb-7028797517e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf07dbf-6f91-4fab-870b-ccf25e49ff65]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9a0bcb88-a08d-4fcf-8d1a-7424c076b5a0 tempest-VolumeQuotasAdminTestJSON-1194163895 None] Created volume successfully. Sep 07 17:06:12 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:12 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:12 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.400s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:12 devstack sudo[99872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf 1G Sep 07 17:06:12 devstack sudo[99872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:12 devstack sudo[99872]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf 1G" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:13 devstack sudo[99878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf Sep 07 17:06:13 devstack sudo[99878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:13 devstack sudo[99878]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf is being set with open permissions: ugo+rw Sep 07 17:06:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:13 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf Sep 07 17:06:13 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:13 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf" returned: 0 in 0.387s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:13 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info Sep 07 17:06:13 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:14 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:14 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info is being set with open permissions: ugo+rw Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:14 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info Sep 07 17:06:14 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fbf38158-2e02-4c57-a206-38448d237f22 tempest-VolumeQuotasAdminTestJSON-1689818588 None] Transfer volume completed successfully. Sep 07 17:06:14 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.info" returned: 0 in 0.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c6342a8e-3822-4eb0-9e76-0e90747af1cf tempest-VolumesExtendTest-1890362956 None] Create snapshot completed successfully Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed07a15-7990-43f3-ae0d-0a0c2aadcc30]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Acquiring lock "cinder-0954efcc-58d3-42d8-a344-51d0017b7ee5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "cinder-0954efcc-58d3-42d8-a344-51d0017b7ee5-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Acquiring lock "cinder-quobyte-0954efcc-58d3-42d8-a344-51d0017b7ee5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "cinder-quobyte-0954efcc-58d3-42d8-a344-51d0017b7ee5" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:15 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:15 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ed1652-319e-4ea2-9dca-fdd1b2e3b3fc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:15 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 Sep 07 17:06:15 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:15 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.605s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf 2G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:15 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5" returned: 0 in 0.432s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:15 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5 Sep 07 17:06:15 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf 2G" returned: 0 in 0.134s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.793s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-51627297-9856-405e-99c6-afddc64e6dff tempest-VolumesExtendTest-1890362956 None] Extend volume completed successfully. Sep 07 17:06:15 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0954efcc-58d3-42d8-a344-51d0017b7ee5" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "cinder-quobyte-0954efcc-58d3-42d8-a344-51d0017b7ee5" released by "delete_volume" :: held 0.774s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Created reservations ['5ffea145-d400-426e-9278-372d584058de', 'aed94ff1-0ebe-4ffd-959b-048cc26e1b46', 'c30be63c-a405-4575-b95e-1f49b8e174c4', '72a8e8c3-7b48-4b80-8d01-fa5a2df6def2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:16 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:16 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-48ae85fe-c70a-4632-abc7-559fdeda9cbf-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-48ae85fe-c70a-4632-abc7-559fdeda9cbf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-quobyte-48ae85fe-c70a-4632-abc7-559fdeda9cbf" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-48ae85fe-c70a-4632-abc7-559fdeda9cbf" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Deleting offline snapshot 48ae85fe-c70a-4632-abc7-559fdeda9cbf of volume 635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] snapshot_file for this snap is: volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6785f7-5a8a-404e-8dcf-c871bfb9fe75]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:16 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Deleted volume successfully. Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4ec453dd-0fc3-457f-8aeb-76b1e609517d tempest-VolumeQuotasAdminTestJSON-2083428656 None] Lock "cinder-0954efcc-58d3-42d8-a344-51d0017b7ee5-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:16 devstack sudo[99913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf Sep 07 17:06:16 devstack sudo[99913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:16 devstack sudo[99913]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1099a31-8ce2-489f-a360-233eebcde79f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:17 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:17 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:17 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:17 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf Sep 07 17:06:17 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:17 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:17 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf Sep 07 17:06:17 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:18 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb.48ae85fe-c70a-4632-abc7-559fdeda9cbf" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-48ae85fe-c70a-4632-abc7-559fdeda9cbf" released by "_delete_snapshot" :: held 1.921s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" released by "delete_snapshot" :: held 1.952s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Created reservations ['954698e3-b197-473f-8ac1-83f32ddb8f19', 'f5f0f141-8bc0-46f9-868d-74039696cdd6', '25778974-df1e-4b17-9ade-c9c50881364b', 'a4ffa8c2-e97a-4e5e-9a14-47082d997b0c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Delete snapshot completed successfully. Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-dd6e7a4b-0551-4760-8afc-5daaa1f87538 tempest-VolumesExtendTest-1890362956 None] Lock "cinder-48ae85fe-c70a-4632-abc7-559fdeda9cbf-delete_snapshot" released by "delete_snapshot" :: held 2.299s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-2fd0aa1f-c546-4cdb-8a1f-a9d906ce298c req-023a77bc-9354-412f-ab63-a4496d44a41b tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-2fd0aa1f-c546-4cdb-8a1f-a9d906ce298c req-023a77bc-9354-412f-ab63-a4496d44a41b tempest-TestStampPattern-418226570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-2fd0aa1f-c546-4cdb-8a1f-a9d906ce298c req-023a77bc-9354-412f-ab63-a4496d44a41b tempest-TestStampPattern-418226570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-2fd0aa1f-c546-4cdb-8a1f-a9d906ce298c req-023a77bc-9354-412f-ab63-a4496d44a41b tempest-TestStampPattern-418226570 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-d573e5d6-525e-4947-840c-b071aa025294', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99fbef28-60b2-4173-9bce-71f9d9767a97', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:06:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-2fd0aa1f-c546-4cdb-8a1f-a9d906ce298c req-023a77bc-9354-412f-ab63-a4496d44a41b tempest-TestStampPattern-418226570 None] attachment_update completed successfully. Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Flow 'volume_create_manager' (22b6b2a5-b340-46e3-bcd7-8c0f676bc1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeaac4d-894d-4120-82b8-949fe94d86f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4aeaac4d-894d-4120-82b8-949fe94d86f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1060155705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ccedc9-b59f-419e-9ab5-1f91e70fe835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5e04bd3ca44e13a492443e96795f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:20Z,use_quota=True,user_id='36928000107f4158930d4caad32027fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cc3052-cdfa-44af-af93-f82b1db4e059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7cc3052-cdfa-44af-af93-f82b1db4e059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22946d60-2590-4c7c-ac7d-6a102008082c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22946d60-2590-4c7c-ac7d-6a102008082c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9ccedc9-b59f-419e-9ab5-1f91e70fe835', 'volume_name': 'volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb4fa0-38b4-4428-bbf5-974b50b9f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35fb4fa0-38b4-4428-bbf5-974b50b9f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b15f764-882e-4b41-9391-9a3678a2493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Volume a9ccedc9-b59f-419e-9ab5-1f91e70fe835: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835', 'volume_size': 2} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1060155705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9ccedc9-b59f-419e-9ab5-1f91e70fe835,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a5e04bd3ca44e13a492443e96795f82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:20Z,use_quota=True,user_id='36928000107f4158930d4caad32027fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Creating volume a9ccedc9-b59f-419e-9ab5-1f91e70fe835 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:19 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 2147483648 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:19 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 2147483648 Sep 07 17:06:19 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "cinder-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Acquiring lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[008e7723-6a4b-4b90-abae-3c4dee68aaea]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:20 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:20 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:20 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:20 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 2147483648" returned: 0 in 0.737s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:20 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb Sep 07 17:06:20 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:20 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 Sep 07 17:06:20 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:20 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:20 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "cinder-quobyte-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb" released by "delete_volume" :: held 0.969s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" returned: 0 in 0.333s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b15f764-882e-4b41-9391-9a3678a2493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835', 'volume_size': 2}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea577a-9cfe-4706-a57e-f8ae8f1de82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Volume volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 (a9ccedc9-b59f-419e-9ab5-1f91e70fe835): created successfully Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64ea577a-9cfe-4706-a57e-f8ae8f1de82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Flow 'volume_create_manager' (22b6b2a5-b340-46e3-bcd7-8c0f676bc1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0d89fad8-a498-4ea5-a569-1980d786d03a tempest-VolumesCloneNegativeTest-1173541779 None] Created volume successfully. Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Created reservations ['f8792ac1-e50a-4165-b0a4-31ef69b1716d', '017e19bc-adc2-4745-a3ea-754fbb1af12c', 'ad39c489-9df4-40a9-a7d6-cc96ca1f8674', '58b8e9e9-bfbb-4add-86a0-184d892676d1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:21 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:21 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:21 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Deleted volume successfully. Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a6624e5b-1251-4008-a3fa-f71b8c9ed7ef tempest-VolumesExtendTest-1890362956 None] Lock "cinder-635d286b-87a3-4e38-bdd2-b1cb9b5b70fb-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Acquiring lock "cinder-a9ccedc9-b59f-419e-9ab5-1f91e70fe835-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "cinder-a9ccedc9-b59f-419e-9ab5-1f91e70fe835-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Acquiring lock "cinder-quobyte-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "cinder-quobyte-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" acquired by "delete_volume" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc1ec29-7f5b-4864-a7be-4f31004578ca]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:22 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 Sep 07 17:06:22 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-0e62d8e8-809f-4f66-bd70-5603fa8debdb req-24a39582-1b72-4fb1-93f2-351a77f1dc46 tempest-TestStampPattern-418226570 None] Terminate volume connection completed successfully. Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-0e62d8e8-809f-4f66-bd70-5603fa8debdb req-24a39582-1b72-4fb1-93f2-351a77f1dc46 tempest-TestStampPattern-418226570 None] Deleting attachment 99fbef28-60b2-4173-9bce-71f9d9767a97. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:06:22 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" returned: 0 in 0.552s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:22 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835 Sep 07 17:06:22 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:22 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "cinder-quobyte-a9ccedc9-b59f-419e-9ab5-1f91e70fe835" released by "delete_volume" :: held 0.892s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Created reservations ['c29af070-a5ee-4c38-a783-f0f83f67da41', '63de681c-2868-4bc3-bbcf-6d6cfef22685', '52d1b7d8-4957-4490-871c-981ea29fc87e', '3abd04b7-5c52-475c-babd-a38572c95e84'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:23 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:23 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:23 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Deleted volume successfully. Sep 07 17:06:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86755072-c30e-4ece-9162-d5c192f98b16 tempest-VolumesCloneNegativeTest-1173541779 None] Lock "cinder-a9ccedc9-b59f-419e-9ab5-1f91e70fe835-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-d573e5d6-525e-4947-840c-b071aa025294-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "cinder-d573e5d6-525e-4947-840c-b071aa025294-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb9c0c7-8237-41a9-b7dc-691616567976]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:28 devstack sudo[100448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 Sep 07 17:06:28 devstack sudo[100448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Flow 'volume_create_manager' (da2d3a72-77a2-4061-b36f-60ee2983f428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e289b11-fcae-49d7-9e39-2ff04fefa239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e289b11-fcae-49d7-9e39-2ff04fefa239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-920325173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7539e579-e01f-4a5f-910c-1ad3d55cdfe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f620b4daf1d14a13bad720e53472c0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:28Z,use_quota=True,user_id='262707ddb81347e781bb48d1a5936871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f5f048-55c6-47c7-893c-f6d4c3c8488c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f5f048-55c6-47c7-893c-f6d4c3c8488c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be304cd1-c100-4919-bcf9-c80f436d0a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be304cd1-c100-4919-bcf9-c80f436d0a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7539e579-e01f-4a5f-910c-1ad3d55cdfe2', 'volume_name': 'volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc14bf4-2618-44f5-9b16-942db41b34b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc14bf4-2618-44f5-9b16-942db41b34b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a70621-291c-4874-af9b-5b0d9b3f7ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Volume 7539e579-e01f-4a5f-910c-1ad3d55cdfe2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2', 'volume_size': 1} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-920325173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7539e579-e01f-4a5f-910c-1ad3d55cdfe2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f620b4daf1d14a13bad720e53472c0f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:28Z,use_quota=True,user_id='262707ddb81347e781bb48d1a5936871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Creating volume 7539e579-e01f-4a5f-910c-1ad3d55cdfe2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:28 devstack sudo[100448]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294" returned: 0 in 0.576s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:28 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 1073741824 Sep 07 17:06:28 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:28 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294 Sep 07 17:06:28 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (47f8062c-72db-4e46-8296-fae92aef6f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732a1358-0fc9-48f1-a39c-b09262c8ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (732a1358-0fc9-48f1-a39c-b09262c8ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1988451727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745de4a2-2c77-46ed-a399-ddee32a93aba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:29Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d14df6-a33f-40ef-82ac-f41091453e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93d14df6-a33f-40ef-82ac-f41091453e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebdfd68-4f30-4353-9299-8a51b60c00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ebdfd68-4f30-4353-9299-8a51b60c00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745de4a2-2c77-46ed-a399-ddee32a93aba', 'volume_name': 'volume-745de4a2-2c77-46ed-a399-ddee32a93aba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca254b64-53e8-432b-bdb8-d56d422a0d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca254b64-53e8-432b-bdb8-d56d422a0d0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746ef829-ffa6-477f-8bcf-d94792687095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Volume 745de4a2-2c77-46ed-a399-ddee32a93aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745de4a2-2c77-46ed-a399-ddee32a93aba', 'volume_size': 1} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d573e5d6-525e-4947-840c-b071aa025294" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-d573e5d6-525e-4947-840c-b071aa025294" released by "delete_volume" :: held 0.986s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Created reservations ['432c8d5f-c6e1-482a-9549-d59449dc2501', '2606305a-619c-470e-b490-632d6cb4b77e', '77c6178d-f494-45bb-965a-a7d01beebe42', '3fc9622d-5447-4a51-bcba-a228df898a79'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:29 devstack sudo[100461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:29 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:29 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 1073741824" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:29 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 Sep 07 17:06:29 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:29 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Deleted volume successfully. Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b8561d92-e706-4009-a0da-8b190fed5ff3 tempest-TestStampPattern-418226570 None] Lock "cinder-d573e5d6-525e-4947-840c-b071aa025294-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:29 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.710s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1988451727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745de4a2-2c77-46ed-a399-ddee32a93aba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:29Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Creating volume 745de4a2-2c77-46ed-a399-ddee32a93aba {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (179d9826-abd5-4c24-b3f2-fe982c6d37d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:29 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba 1073741824 Sep 07 17:06:29 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fed2d5c-4e14-4ec1-b6c5-3f2da99afe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a70621-291c-4874-af9b-5b0d9b3f7ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4c0820-ca4f-4ead-b0fb-b2c0e8390ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fed2d5c-4e14-4ec1-b6c5-3f2da99afe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-143042072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:30Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e927d051-39d3-46a0-837a-74ca324dfe63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e927d051-39d3-46a0-837a-74ca324dfe63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b387738e-bde2-4dff-b8e4-4064e4657eeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b387738e-bde2-4dff-b8e4-4064e4657eeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8', 'volume_name': 'volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820e679d-cb6f-48a2-a136-1652e594ba6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (820e679d-cb6f-48a2-a136-1652e594ba6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62eecccf-b8c8-45e9-8f33-c802e721dbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Volume 38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8', 'volume_size': 1} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-02627460-e356-425f-bfd5-e341044e82c6-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Volume volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 (7539e579-e01f-4a5f-910c-1ad3d55cdfe2): created successfully Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a4c0820-ca4f-4ead-b0fb-b2c0e8390ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Flow 'volume_create_manager' (da2d3a72-77a2-4061-b36f-60ee2983f428) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-02627460-e356-425f-bfd5-e341044e82c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-be022e12-05d5-4727-ac3b-d68cf517908e tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Created volume successfully. Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Deleting offline snapshot 02627460-e356-425f-bfd5-e341044e82c6 of volume 3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] snapshot_file for this snap is: volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c142bf4-c040-482c-9bee-610446468ccc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:30 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:06:30 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:30 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba 1073741824" returned: 0 in 0.472s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:30 devstack sudo[100475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba Sep 07 17:06:30 devstack sudo[100475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:30 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a7cf11e-a111-4160-a295-02daf45afdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed58338b-83d1-4ee0-90d7-24f09f69598c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:30 devstack sudo[100475]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-143042072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:30Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Creating volume 38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:30 devstack sudo[100480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:06:30 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:30 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 1073741824 Sep 07 17:06:30 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746ef829-ffa6-477f-8bcf-d94792687095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745de4a2-2c77-46ed-a399-ddee32a93aba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b2d14d-084e-4d67-9297-22538dd7815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Volume volume-745de4a2-2c77-46ed-a399-ddee32a93aba (745de4a2-2c77-46ed-a399-ddee32a93aba): created successfully Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2b2d14d-084e-4d67-9297-22538dd7815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (47f8062c-72db-4e46-8296-fae92aef6f97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9c981c7f-0765-4f67-8f66-f792d4e79b85 tempest-VolumesListTestJSON-1882545561 None] Created volume successfully. Sep 07 17:06:30 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.570s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:31 devstack sudo[100492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:06:31 devstack sudo[100492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:31 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 1073741824" returned: 0 in 0.518s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:31 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 Sep 07 17:06:31 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:31 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:31 devstack sudo[100492]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62eecccf-b8c8-45e9-8f33-c802e721dbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0c95-61b3-493e-bf5c-a51dcb59b97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6 Sep 07 17:06:31 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Volume volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 (38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8): created successfully Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (857d0c95-61b3-493e-bf5c-a51dcb59b97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (179d9826-abd5-4c24-b3f2-fe982c6d37d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-954382a2-960f-4f67-9520-4182f99e83a0 tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (c159a8ad-1f10-49fb-9a0d-3819cb42f1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd6c24c-e385-4fa3-aeec-98090d5c3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebd6c24c-e385-4fa3-aeec-98090d5c3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-293433403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8816d3-2b80-44b2-b4f3-e3adefb29bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:32Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10842e4a-fe72-464a-951f-3ba83e82c2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10842e4a-fe72-464a-951f-3ba83e82c2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14af7152-48c0-4bba-93fd-1166dfd4dfbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14af7152-48c0-4bba-93fd-1166dfd4dfbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8816d3-2b80-44b2-b4f3-e3adefb29bb0', 'volume_name': 'volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94748f01-b9ad-4285-b2cc-84649d8a55bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94748f01-b9ad-4285-b2cc-84649d8a55bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cdd042-1f58-4db2-a23f-7d7fbe9c37cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Volume 4d8816d3-2b80-44b2-b4f3-e3adefb29bb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0', 'volume_size': 1} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-293433403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8816d3-2b80-44b2-b4f3-e3adefb29bb0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:32Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Creating volume 4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:31 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1.02627460-e356-425f-bfd5-e341044e82c6" returned: 0 in 0.366s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:31 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 1073741824 Sep 07 17:06:31 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-02627460-e356-425f-bfd5-e341044e82c6" released by "_delete_snapshot" :: held 1.906s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" released by "delete_snapshot" :: held 1.936s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Acquiring lock "cinder-7539e579-e01f-4a5f-910c-1ad3d55cdfe2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Created reservations ['e42c967a-a918-48a9-a652-af1d86c98397', '32ee89fb-5965-4de0-ac3e-31ceb04e928d', 'e1dcb8fb-2f8e-4b03-8c48-7d152eb21b39', 'bd490513-03bc-4bc3-b975-d68d7b4de5ee'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "cinder-7539e579-e01f-4a5f-910c-1ad3d55cdfe2-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Acquiring lock "cinder-quobyte-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "cinder-quobyte-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Delete snapshot completed successfully. Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e2f6e450-fbb1-49f7-ad17-40fa0d485fce tempest-TestStampPattern-418226570 None] Lock "cinder-02627460-e356-425f-bfd5-e341044e82c6-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4d43e7-af58-47c8-8df0-9155ab8cb09c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:32 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 Sep 07 17:06:32 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:32 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 1073741824" returned: 0 in 0.576s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:32 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 Sep 07 17:06:32 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:32 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" returned: 0 in 0.543s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:32 devstack sudo[100519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2 Sep 07 17:06:32 devstack sudo[100519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:32 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (e9937445-5003-4570-a662-de7e0d56ef5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0452cded-28f1-450d-ade2-9dbe6f8ee706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0452cded-28f1-450d-ade2-9dbe6f8ee706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2142339979',display_name='tempest-VolumesGetTest-Volume-163585554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96911d80-75a1-4449-8453-cdc12bc477be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:33Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feafcad-6234-4725-bfa3-07865e48a5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3feafcad-6234-4725-bfa3-07865e48a5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7481f1-021b-4d38-8886-959e5aa19321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f7481f1-021b-4d38-8886-959e5aa19321) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96911d80-75a1-4449-8453-cdc12bc477be', 'volume_name': 'volume-96911d80-75a1-4449-8453-cdc12bc477be', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d6a7a9-e14e-484b-8266-7a22ae20f299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92d6a7a9-e14e-484b-8266-7a22ae20f299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40368df-d63a-4b32-bf00-477a629d1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Volume 96911d80-75a1-4449-8453-cdc12bc477be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96911d80-75a1-4449-8453-cdc12bc477be', 'volume_size': 1} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2142339979',display_name='tempest-VolumesGetTest-Volume-163585554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96911d80-75a1-4449-8453-cdc12bc477be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:33Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Creating volume 96911d80-75a1-4449-8453-cdc12bc477be {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:32 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70cdd042-1f58-4db2-a23f-7d7fbe9c37cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7bc30-9812-4afb-94be-90c7a2e2aa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:32 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be 1073741824 Sep 07 17:06:32 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Volume volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 (4d8816d3-2b80-44b2-b4f3-e3adefb29bb0): created successfully Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed7bc30-9812-4afb-94be-90c7a2e2aa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (c159a8ad-1f10-49fb-9a0d-3819cb42f1e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-51440aea-e7cd-448b-b118-f36bd7930d35 tempest-VolumesListTestJSON-1882545561 None] Created volume successfully. Sep 07 17:06:32 devstack sudo[100519]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "cinder-quobyte-7539e579-e01f-4a5f-910c-1ad3d55cdfe2" released by "delete_volume" :: held 0.933s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Created reservations ['f651156d-cb96-4de8-a854-3e95e78c755d', 'cf03a311-d728-40f5-a4ac-9fd576d1ef96', 'd6e59a4a-c539-476d-87a5-78ff260a256a', 'a7445b86-e481-4079-a156-98f4e42711fb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:33 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:33 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:33 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be 1073741824" returned: 0 in 0.606s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:33 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.335s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Deleted volume successfully. Sep 07 17:06:33 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be Sep 07 17:06:33 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-591e3bc0-d99c-489d-a142-ed5335f6c41f tempest-VolumeQuotasNegativeTestJSON-1696236235 None] Lock "cinder-7539e579-e01f-4a5f-910c-1ad3d55cdfe2-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:34 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be" returned: 0 in 0.511s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c40368df-d63a-4b32-bf00-477a629d1af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96911d80-75a1-4449-8453-cdc12bc477be', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4368f224-aa20-4bb7-99f2-7fcaf0f39ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Volume volume-96911d80-75a1-4449-8453-cdc12bc477be (96911d80-75a1-4449-8453-cdc12bc477be): created successfully Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4368f224-aa20-4bb7-99f2-7fcaf0f39ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (e9937445-5003-4570-a662-de7e0d56ef5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2b69f0b7-d20c-469a-b994-b6e5d70dd73a tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (11a2aaee-e39a-48c7-8f1f-f46b6d322a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e7ce04-01b2-4b11-b770-e81885edbae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7e7ce04-01b2-4b11-b770-e81885edbae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-179244085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2dadd2-2178-485b-bfd8-bb5797dd86ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:35Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48d5023-3098-47b4-94bf-dee524dad9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d48d5023-3098-47b4-94bf-dee524dad9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0145253f-8fdd-4736-90f2-3388295cd128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0145253f-8fdd-4736-90f2-3388295cd128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be2dadd2-2178-485b-bfd8-bb5797dd86ca', 'volume_name': 'volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75a5ce-6c25-4b34-a467-2a8da230270f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c75a5ce-6c25-4b34-a467-2a8da230270f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3149b-acdc-41b6-ab65-7469ae669bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Volume be2dadd2-2178-485b-bfd8-bb5797dd86ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca', 'volume_size': 1} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-179244085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be2dadd2-2178-485b-bfd8-bb5797dd86ca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9718ae22ceda40caa5e5d1b0b0858cb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:35Z,use_quota=True,user_id='d823377163ad4408a35a438cd7168160',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Creating volume be2dadd2-2178-485b-bfd8-bb5797dd86ca {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:34 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca 1073741824 Sep 07 17:06:34 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-96911d80-75a1-4449-8453-cdc12bc477be-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "cinder-96911d80-75a1-4449-8453-cdc12bc477be-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-96911d80-75a1-4449-8453-cdc12bc477be" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-96911d80-75a1-4449-8453-cdc12bc477be" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5daf8-8b5a-4b80-b3b6-55194c01388a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:35 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be Sep 07 17:06:35 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:35 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca 1073741824" returned: 0 in 0.834s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:35 devstack sudo[100571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca Sep 07 17:06:35 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:35 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:35 devstack sudo[100577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be Sep 07 17:06:35 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:35 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe3149b-acdc-41b6-ab65-7469ae669bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d2082f-7214-40ea-87b7-4cd2e4a09da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Volume volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca (be2dadd2-2178-485b-bfd8-bb5797dd86ca): created successfully Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3d2082f-7214-40ea-87b7-4cd2e4a09da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Flow 'volume_create_manager' (11a2aaee-e39a-48c7-8f1f-f46b6d322a0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7959ab40-f182-44ac-9c6b-7f27939b4bb4 tempest-VolumesListTestJSON-1882545561 None] Created volume successfully. Sep 07 17:06:36 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96911d80-75a1-4449-8453-cdc12bc477be" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-96911d80-75a1-4449-8453-cdc12bc477be" released by "delete_volume" :: held 0.818s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Created reservations ['eca36687-ab47-44c1-b148-7ac9377aef39', 'ea27fce7-4536-4150-a2a7-0f61b53920bc', 'b239bb28-b627-4a99-8cf5-eb10ae9b825c', '10b16b18-3249-46f2-bd7c-a08214b41f17'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:36 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:36 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-3a7cf11e-a111-4160-a295-02daf45afdc1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "cinder-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "cinder-3a7cf11e-a111-4160-a295-02daf45afdc1-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Acquiring lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:36 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdfd4ae-3ad3-4044-b83a-5a2416c05174]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[196f0a04-a28f-48b0-b825-d6349b6bf3b1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:06:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-03f920e9-175e-49b1-baff-03b523ceb271 tempest-VolumesGetTest-966375200 None] Lock "cinder-96911d80-75a1-4449-8453-cdc12bc477be-delete_volume" released by "delete_volume" :: held 1.627s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:36 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 Sep 07 17:06:36 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:36 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:06:36 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:37 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:37 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:37 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8 Sep 07 17:06:37 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.483s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:37 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1 Sep 07 17:06:37 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:37 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8" released by "delete_volume" :: held 0.893s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:37 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a7cf11e-a111-4160-a295-02daf45afdc1" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "cinder-quobyte-3a7cf11e-a111-4160-a295-02daf45afdc1" released by "delete_volume" :: held 0.942s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Created reservations ['e5e3410c-b965-4902-a8b7-3dc215e27e2e', 'f58bbc34-07c6-409d-ae16-5ab9ecc16c9c', '30ea86f4-5698-43ef-af4d-157320fab098', '6fa53bf1-d996-4fa1-9106-2c927b9fe4c7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Created reservations ['0053f57c-cbd0-4db4-a82b-134b488a4e52', '0edd9482-6bb5-4a0b-9243-61b28e9f9de3', '861fea69-ba74-4277-84df-ea7362e48ee1', 'd5dd88f4-3eb2-4acc-b430-ded44c2e600c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:37 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:37 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:37 devstack sudo[100603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:37 devstack sudo[100603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:38 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d3b6bd5-5028-4780-b357-e91edb364043 tempest-VolumesGetTest-966375200 None] Lock "cinder-38d707cd-e9d2-4aaa-84ec-ca8ab36e62a8-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:38 devstack sudo[100603]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Deleted volume successfully. Sep 07 17:06:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-038d2702-504f-4671-a482-eb589e560152 tempest-TestStampPattern-418226570 None] Lock "cinder-3a7cf11e-a111-4160-a295-02daf45afdc1-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (0956bc93-297c-4ebe-86d7-f54006d091eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4edf462-3be7-4432-af13-9c80c166b9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4edf462-3be7-4432-af13-9c80c166b9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-795200831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3357ada8-cd6a-4946-8558-4749372dcef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:39Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342084d3-e11b-41cf-a5d4-5a074c889f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (342084d3-e11b-41cf-a5d4-5a074c889f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df2ce26-f1ef-41e0-bedc-6729cc19f328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9df2ce26-f1ef-41e0-bedc-6729cc19f328) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3357ada8-cd6a-4946-8558-4749372dcef2', 'volume_name': 'volume-3357ada8-cd6a-4946-8558-4749372dcef2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3bd63d-8b2e-47a3-b88d-18ba767b3d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a3bd63d-8b2e-47a3-b88d-18ba767b3d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e4c37-e0f4-456d-98c7-f401a832a186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:39 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Volume 3357ada8-cd6a-4946-8558-4749372dcef2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3357ada8-cd6a-4946-8558-4749372dcef2', 'volume_size': 1} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-795200831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3357ada8-cd6a-4946-8558-4749372dcef2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:39Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Creating volume 3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:39 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:39 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 1073741824 Sep 07 17:06:39 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-be2dadd2-2178-485b-bfd8-bb5797dd86ca-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-be2dadd2-2178-485b-bfd8-bb5797dd86ca-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-quobyte-be2dadd2-2178-485b-bfd8-bb5797dd86ca" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-be2dadd2-2178-485b-bfd8-bb5797dd86ca" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad43334-31a7-4a10-a3c6-af485a3504f3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:40 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca Sep 07 17:06:40 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:40 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 1073741824" returned: 0 in 0.629s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=134,cinder:UPDATE=176,cinder:INSERT=52,cinder:DELETE=18 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:40 devstack sudo[100653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:06:40 devstack sudo[100653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:40 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:40 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca Sep 07 17:06:40 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:40 devstack sudo[100653]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f7e4c37-e0f4-456d-98c7-f401a832a186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3357ada8-cd6a-4946-8558-4749372dcef2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962f832b-d355-45cb-ae60-6a120529c491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Volume volume-3357ada8-cd6a-4946-8558-4749372dcef2 (3357ada8-cd6a-4946-8558-4749372dcef2): created successfully Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962f832b-d355-45cb-ae60-6a120529c491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (0956bc93-297c-4ebe-86d7-f54006d091eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f2444365-0061-46c1-8a44-5c3600eb242e tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:06:40 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be2dadd2-2178-485b-bfd8-bb5797dd86ca" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-be2dadd2-2178-485b-bfd8-bb5797dd86ca" released by "delete_volume" :: held 0.883s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Created reservations ['106729b0-2315-4d06-878b-befbe806ffbd', '5462cc00-0c3d-4f7f-8f74-742464622814', '895f9817-b6b2-4761-a965-d3382ea91365', '7cfe4906-b701-4686-9bed-2e3aa26847ec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:40 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:40 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-quobyte-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7e8bec-1a38-4fe1-b324-94cc02f969ba]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:41 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Deleted volume successfully. Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f474e9df-3845-4e2a-a976-54ebd2ebdbad tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-be2dadd2-2178-485b-bfd8-bb5797dd86ca-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:41 devstack sudo[100662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 Sep 07 17:06:41 devstack sudo[100662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:41 devstack sudo[100662]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:41 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0 Sep 07 17:06:41 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:42 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0" released by "delete_volume" :: held 0.927s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=149,cinder:UPDATE=196,cinder:INSERT=46,cinder:DELETE=11 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (3078d21b-8ce8-4a0e-91c1-ca528c4d8433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134647e-b631-47d5-ae50-88b776542242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Created reservations ['1530966f-1cd6-490a-bf50-ad0bd6615984', 'c9aa66e2-883b-43f0-bd3b-f3c5b6089919', '09292c01-8929-461e-953e-9ba19b367529', '4b47b3a6-aaa6-41cb-bc8c-f5e9e05dc7ee'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2134647e-b631-47d5-ae50-88b776542242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1046852912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d366e51-3758-4d4a-b02d-d055e7248bba,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=3357ada8-cd6a-4946-8558-4749372dcef2,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:42Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623eb8ea-ec07-465c-9ef9-dd572abb38ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623eb8ea-ec07-465c-9ef9-dd572abb38ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cd1728-ac48-4f2b-85de-6513b5936757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46cd1728-ac48-4f2b-85de-6513b5936757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3d366e51-3758-4d4a-b02d-d055e7248bba', 'volume_name': 'volume-3d366e51-3758-4d4a-b02d-d055e7248bba', 'volume_size': 1, 'source_volid': '3357ada8-cd6a-4946-8558-4749372dcef2', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3e5182-049e-48d8-9e5c-583f4cbf8a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc3e5182-049e-48d8-9e5c-583f4cbf8a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39190bd3-4871-4a08-829a-53a1ac89e044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Volume 3d366e51-3758-4d4a-b02d-d055e7248bba: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3d366e51-3758-4d4a-b02d-d055e7248bba', 'volume_size': 1, 'source_volid': '3357ada8-cd6a-4946-8558-4749372dcef2', 'source_volstatus': 'available'} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Cloning volume 3357ada8-cd6a-4946-8558-4749372dcef2 to volume 3d366e51-3758-4d4a-b02d-d055e7248bba Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Creating offline snapshot dcf28774-7599-4d45-8b9f-200ab60d2e12 of volume 3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c603087-5c33-42be-af0b-a659ed7aeae7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:42 devstack sudo[100672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:42 devstack sudo[100672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:42 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:06:42 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:42 devstack sudo[100672]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Deleted volume successfully. Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ed789be2-6137-4356-9d7f-f1e6df54af0d tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-4d8816d3-2b80-44b2-b4f3-e3adefb29bb0-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:42 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.499s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:42 devstack sudo[100680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 1G Sep 07 17:06:42 devstack sudo[100680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-745de4a2-2c77-46ed-a399-ddee32a93aba-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-745de4a2-2c77-46ed-a399-ddee32a93aba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:43 devstack sudo[100680]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 1G" returned: 0 in 0.549s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3357ada8-cd6a-4946-8558-4749372dcef2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:43 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3357ada8-cd6a-4946-8558-4749372dcef2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:43 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "cinder-quobyte-745de4a2-2c77-46ed-a399-ddee32a93aba" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-745de4a2-2c77-46ed-a399-ddee32a93aba" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ac0375-c8bf-4e97-9b1c-3d071a4c152b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:43 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba Sep 07 17:06:43 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:43 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3357ada8-cd6a-4946-8558-4749372dcef2 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 is being set with open permissions: ugo+rw Sep 07 17:06:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:43 devstack sudo[100693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:43 devstack sudo[100693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:44 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba" returned: 0 in 0.487s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:44 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba Sep 07 17:06:44 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:44 devstack sudo[100693]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:44 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info Sep 07 17:06:44 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:44 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-745de4a2-2c77-46ed-a399-ddee32a93aba" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-quobyte-745de4a2-2c77-46ed-a399-ddee32a93aba" released by "delete_volume" :: held 0.922s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Created reservations ['36222dde-188e-4fb0-be87-f0892b637adf', 'fd0ef4f7-f7eb-403d-abc5-653324ee4119', '6543ca8f-a6bb-44e0-8bdc-adafdc0470ca', '55e343b0-0e75-4982-b2ad-c31ce63759b7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:44 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info is being set with open permissions: ugo+rw Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:44 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info Sep 07 17:06:44 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:44 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:44 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:44 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.info" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:44 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Deleted volume successfully. Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] snapshot: dcf28774-7599-4d45-8b9f-200ab60d2e12, volume: 3d366e51-3758-4d4a-b02d-d055e7248bba, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f4bc5ab9-310b-4d73-86f3-783f62e0c421 tempest-VolumesListTestJSON-1882545561 None] Lock "cinder-745de4a2-2c77-46ed-a399-ddee32a93aba-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4554d37-5cee-4f23-aafa-5e2cf4267f5e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:45 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:45 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:45 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.639s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3357ada8-cd6a-4946-8558-4749372dcef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0c160b-2c7a-4b31-bf3a-58dcedbcbd94]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:45 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:06:45 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:46 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:06:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:06:46 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:06:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:46 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba Sep 07 17:06:46 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:51 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba" returned: 0 in 5.662s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:51 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2, size 1024.00 MB, duration 5.66 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:06:51 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Converted 1024.00 MB image at 180.80 MB/s Sep 07 17:06:51 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba is being set with open permissions: ugo+rw Sep 07 17:06:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:51 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba Sep 07 17:06:51 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:52 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" released by "_copy_volume_from_snapshot" :: held 7.242s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-dcf28774-7599-4d45-8b9f-200ab60d2e12" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-dcf28774-7599-4d45-8b9f-200ab60d2e12" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Deleting offline snapshot dcf28774-7599-4d45-8b9f-200ab60d2e12 of volume 3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] snapshot_file for this snap is: volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[db694856-75da-4afd-b029-1611f75f9929]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:52 devstack sudo[100747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:52 devstack sudo[100747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:52 devstack sudo[100747]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.415s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3357ada8-cd6a-4946-8558-4749372dcef2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[207c252d-8377-4a66-b927-3fa5ef287b2d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:52 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:06:52 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:53 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.650s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:53 devstack sudo[100758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:53 devstack sudo[100758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:53 devstack sudo[100758]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:53 devstack sudo[100763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12 Sep 07 17:06:53 devstack sudo[100763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:54 devstack sudo[100763]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2.dcf28774-7599-4d45-8b9f-200ab60d2e12" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-dcf28774-7599-4d45-8b9f-200ab60d2e12" released by "_delete_snapshot" :: held 1.871s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.906s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39190bd3-4871-4a08-829a-53a1ac89e044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d366e51-3758-4d4a-b02d-d055e7248bba', 'volume_size': 1, 'source_volid': '3357ada8-cd6a-4946-8558-4749372dcef2', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f03dbd-02aa-4b67-b71c-5448ac37bc9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Volume volume-3d366e51-3758-4d4a-b02d-d055e7248bba (3d366e51-3758-4d4a-b02d-d055e7248bba): created successfully Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1f03dbd-02aa-4b67-b71c-5448ac37bc9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (3078d21b-8ce8-4a0e-91c1-ca528c4d8433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6957b213-b74d-40b9-a286-dfbd84e6f5fb tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (16bdf150-2fca-48e1-845e-f419f94f2929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c52efd-6611-41bd-b8a4-4c18ff836ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c52efd-6611-41bd-b8a4-4c18ff836ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119642262',display_name='tempest-VolumesGetTest-Volume-1365974595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960a4555-149e-4c9e-a5fd-1784f7cbc62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:55Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b3f4c6-5cbc-4866-a3a8-9262ba14cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b3f4c6-5cbc-4866-a3a8-9262ba14cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c29d807-30ad-431d-8f85-e48df9cad1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c29d807-30ad-431d-8f85-e48df9cad1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '960a4555-149e-4c9e-a5fd-1784f7cbc62b', 'volume_name': 'volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b87fcb-f8ec-41cf-87c2-8179195db8ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4b87fcb-f8ec-41cf-87c2-8179195db8ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586cb52d-ecfa-4ede-a9a3-4ca340bcdce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Volume 960a4555-149e-4c9e-a5fd-1784f7cbc62b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b', 'volume_size': 1} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:06:55Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1119642262',display_name='tempest-VolumesGetTest-Volume-1365974595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=960a4555-149e-4c9e-a5fd-1784f7cbc62b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:06:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:06:55Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Creating volume 960a4555-149e-4c9e-a5fd-1784f7cbc62b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:06:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:06:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:55 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b 1073741824 Sep 07 17:06:55 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:56 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b 1073741824" returned: 0 in 0.610s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:56 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b Sep 07 17:06:56 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:56 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b" returned: 0 in 0.333s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] <== create_volume: return (1007ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (586cb52d-ecfa-4ede-a9a3-4ca340bcdce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e85093-47bc-41c3-b12e-c1dfc7c5ef4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:06:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Volume volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b (960a4555-149e-4c9e-a5fd-1784f7cbc62b): created successfully Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e85093-47bc-41c3-b12e-c1dfc7c5ef4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:06:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (16bdf150-2fca-48e1-845e-f419f94f2929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:06:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e6c36769-7c62-4edd-8ff2-c3a106d07232 tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-960a4555-149e-4c9e-a5fd-1784f7cbc62b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "cinder-960a4555-149e-4c9e-a5fd-1784f7cbc62b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-960a4555-149e-4c9e-a5fd-1784f7cbc62b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-960a4555-149e-4c9e-a5fd-1784f7cbc62b" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf10d2d-6aca-44d3-ae29-b77faa8ac520]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:06:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:58 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b Sep 07 17:06:58 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:58 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:58 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b Sep 07 17:06:58 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:58 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-960a4555-149e-4c9e-a5fd-1784f7cbc62b" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-960a4555-149e-4c9e-a5fd-1784f7cbc62b" released by "delete_volume" :: held 0.951s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:06:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Created reservations ['a0780fed-d18c-4f3f-871b-0e0e1faad5c0', '08f959bf-9a7b-496e-a75a-01ff2f720bc1', '8b74af1b-3303-4e54-97d6-253de98b1404', '0e6372ec-bf89-4205-ae14-3fc02b67a571'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:06:59 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:06:59 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:06:59 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:06:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:06:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-34a965d1-8354-4545-b95c-614084c73286 tempest-VolumesGetTest-966375200 None] Lock "cinder-960a4555-149e-4c9e-a5fd-1784f7cbc62b-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-3d366e51-3758-4d4a-b02d-d055e7248bba-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "cinder-3d366e51-3758-4d4a-b02d-d055e7248bba-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1153ec8c-1f38-4c11-9052-80b3f9894548]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:00 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba Sep 07 17:07:00 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Flow 'volume_create_manager' (e7da29c7-eaa6-4f75-8237-7ec93f718bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db2cb56-d850-4200-b35f-57839dbb4db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8db2cb56-d850-4200-b35f-57839dbb4db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1125023247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6607dd0-98de-4353-8aa2-ebb1d32ee28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c52fdae4ed4881aec700fba201bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:01Z,use_quota=True,user_id='976b02bbb23b4182881a250cfeb581ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23511f9-ac0d-4852-9b9e-e21648205d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23511f9-ac0d-4852-9b9e-e21648205d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66bf067-d469-4f25-ad42-669d9e6cbc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66bf067-d469-4f25-ad42-669d9e6cbc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6607dd0-98de-4353-8aa2-ebb1d32ee28f', 'volume_name': 'volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e1ee0e-ba29-4028-8e5a-806fee60be98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2e1ee0e-ba29-4028-8e5a-806fee60be98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a66a35-c97e-4bf0-8e8d-62db8f3cc790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:00 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Volume a6607dd0-98de-4353-8aa2-ebb1d32ee28f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f', 'volume_size': 1} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1125023247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6607dd0-98de-4353-8aa2-ebb1d32ee28f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c52fdae4ed4881aec700fba201bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:01Z,use_quota=True,user_id='976b02bbb23b4182881a250cfeb581ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Creating volume a6607dd0-98de-4353-8aa2-ebb1d32ee28f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:00 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:00 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f 1073741824 Sep 07 17:07:00 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:00 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:00 devstack sudo[100795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba Sep 07 17:07:00 devstack sudo[100795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:01 devstack sudo[100795]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d366e51-3758-4d4a-b02d-d055e7248bba" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3d366e51-3758-4d4a-b02d-d055e7248bba" released by "delete_volume" :: held 0.984s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:01 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f 1073741824" returned: 0 in 0.621s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Created reservations ['b66c30af-443c-4f5b-81b0-79cfd4dfcb63', 'b2aaf3a1-0c0a-4d26-a4f5-ef8ea60c9235', '941a57ea-ff3a-439e-a5f4-51cd3bdfd2a6', '78bef567-5dce-449a-be65-5665b9720aba'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:01 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f Sep 07 17:07:01 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:01 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:01 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:01 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] <== create_volume: return (1094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a66a35-c97e-4bf0-8e8d-62db8f3cc790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90506ee0-9c55-45be-adaa-13941c75a815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:01 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Volume volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f (a6607dd0-98de-4353-8aa2-ebb1d32ee28f): created successfully Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90506ee0-9c55-45be-adaa-13941c75a815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Flow 'volume_create_manager' (e7da29c7-eaa6-4f75-8237-7ec93f718bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:07:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-db7ddb0e-e4ff-4695-a0e0-a8c88544e59a tempest-VolumesTransfersV355Test-1572577279 None] Created volume successfully. Sep 07 17:07:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-597b555e-a0c6-45a4-bed3-c47511282071 tempest-VolumesGetTest-966375200 None] Lock "cinder-3d366e51-3758-4d4a-b02d-d055e7248bba-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-3357ada8-cd6a-4946-8558-4749372dcef2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "cinder-3357ada8-cd6a-4946-8558-4749372dcef2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-3357ada8-cd6a-4946-8558-4749372dcef2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3357ada8-cd6a-4946-8558-4749372dcef2" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edd14da-e980-4f26-ac49-c5003e478a17]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:03 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:07:03 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:03 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:03 devstack sudo[100813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2 Sep 07 17:07:03 devstack sudo[100813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:03 devstack sudo[100813]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3357ada8-cd6a-4946-8558-4749372dcef2" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-3357ada8-cd6a-4946-8558-4749372dcef2" released by "delete_volume" :: held 0.914s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Created reservations ['5908675b-6dcc-4cc2-a88b-6223845006e5', '021ccee1-dff3-4c36-bede-4beefd1ad347', '7682c91d-7f85-4a7b-8be6-162bb7830950', '0aef1c80-3a16-471b-9fbd-78e045d057ac'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-804fefa7-9eb3-4d3a-ad96-b87c95eb9066 tempest-VolumesTransfersV355Test-1899823715 None] Transfer volume completed successfully. Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:03 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:03 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:04 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1388289b-311b-4cf8-a4d8-761d95c9159b tempest-VolumesGetTest-966375200 None] Lock "cinder-3357ada8-cd6a-4946-8558-4749372dcef2-delete_volume" released by "delete_volume" :: held 1.623s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "cinder-a6607dd0-98de-4353-8aa2-ebb1d32ee28f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-a6607dd0-98de-4353-8aa2-ebb1d32ee28f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "cinder-quobyte-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-quobyte-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f4aa6d-2588-46de-9b46-5a6d0b750d94]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:04 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f Sep 07 17:07:04 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:05 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:05 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f Sep 07 17:07:05 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:05 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-quobyte-a6607dd0-98de-4353-8aa2-ebb1d32ee28f" released by "delete_volume" :: held 0.935s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Created reservations ['46df5286-9938-4467-981d-9304cffc9e5c', '6620e948-af30-4e36-b8e5-2117bb9e95fd', '91e4f75b-7c04-473f-b817-3ac26839828f', '0e6be9f8-90b3-4191-a353-9311d24ccbf9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:05 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:05 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (51f07220-84a5-4142-94ce-af822675b683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d72450b-a90d-4d73-a55a-97264f4fedb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d72450b-a90d-4d73-a55a-97264f4fedb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-822138554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a3501-dec5-4458-9b82-773ab30652e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:06Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1b225-880a-4b58-8a40-4f7c4f9997cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67e1b225-880a-4b58-8a40-4f7c4f9997cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93db7542-1baf-4430-85e7-12a7e379031b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:07:06 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Deleted volume successfully. Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f9e8548-c690-422d-b4f5-c0ab68175371 tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-a6607dd0-98de-4353-8aa2-ebb1d32ee28f-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93db7542-1baf-4430-85e7-12a7e379031b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '079a3501-dec5-4458-9b82-773ab30652e4', 'volume_name': 'volume-079a3501-dec5-4458-9b82-773ab30652e4', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e46c6e9-4513-4d05-9803-2272d64766b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e46c6e9-4513-4d05-9803-2272d64766b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934ea313-97f1-4aef-bda3-7d8a9ac2ee16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Volume 079a3501-dec5-4458-9b82-773ab30652e4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-079a3501-dec5-4458-9b82-773ab30652e4', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Trying to clone 079a3501-dec5-4458-9b82-773ab30652e4 from image 77b14ba4-a343-4bd3-897b-c62c1df35519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:07:06 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:07:06 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Image download 20.69 MB at 20.69 MB/s Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0604ca7-53b8-4760-9400-6067d842414d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:07 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD Sep 07 17:07:07 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:07 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 is fetched for user 1328b268724d408e837244f07c892acc. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3266d366-8561-4f43-8a67-5ef339bd6841]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:07 devstack sudo[100838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD Sep 07 17:07:07 devstack sudo[100838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Flow 'volume_create_manager' (bf8d9a08-7238-407a-aeaa-acfe1ab070eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea24947-d127-44e5-b9f8-8356dd667a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ea24947-d127-44e5-b9f8-8356dd667a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665427940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4364d0-7950-4d29-bbb0-6623a3f97cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c52fdae4ed4881aec700fba201bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:08Z,use_quota=True,user_id='976b02bbb23b4182881a250cfeb581ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75456da-56f8-4c5a-a782-12c8e1e332ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75456da-56f8-4c5a-a782-12c8e1e332ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a06aef-b336-497b-b948-c6a155811ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9a06aef-b336-497b-b948-c6a155811ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef4364d0-7950-4d29-bbb0-6623a3f97cd3', 'volume_name': 'volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e7ab4-b853-46ac-ae1f-6c5003905165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df2e7ab4-b853-46ac-ae1f-6c5003905165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50559d0b-ae01-48c3-acd2-540e819c7131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Volume ef4364d0-7950-4d29-bbb0-6623a3f97cd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3', 'volume_size': 1} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665427940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4364d0-7950-4d29-bbb0-6623a3f97cd3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7c52fdae4ed4881aec700fba201bb5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:08Z,use_quota=True,user_id='976b02bbb23b4182881a250cfeb581ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Creating volume ef4364d0-7950-4d29-bbb0-6623a3f97cd3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:07 devstack sudo[100840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 1073741824 Sep 07 17:07:07 devstack sudo[100840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:08 devstack sudo[100838]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:08 devstack sudo[100840]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 1073741824" returned: 0 in 0.596s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:08 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 Sep 07 17:07:08 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:08 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.782s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-822138554',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=079a3501-dec5-4458-9b82-773ab30652e4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:06Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Creating volume 079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50559d0b-ae01-48c3-acd2-540e819c7131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01151d6-50f0-4d40-9a4f-83df077b0f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:08 devstack sudo[100855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1073741824 Sep 07 17:07:08 devstack sudo[100855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Volume volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 (ef4364d0-7950-4d29-bbb0-6623a3f97cd3): created successfully Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01151d6-50f0-4d40-9a4f-83df077b0f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Flow 'volume_create_manager' (bf8d9a08-7238-407a-aeaa-acfe1ab070eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ae4d546d-368d-494b-8d58-bc29acee8076 tempest-VolumesTransfersV355Test-1572577279 None] Created volume successfully. Sep 07 17:07:09 devstack sudo[100855]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1073741824" returned: 0 in 0.611s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:09 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 Sep 07 17:07:09 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:09 devstack sudo[100863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:09 devstack sudo[100863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:09 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:09 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Attempting download of 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 079a3501-dec5-4458-9b82-773ab30652e4. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e72746-e4f0-4ce6-8eec-ed13a4f44c7c]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "cinder-ef4364d0-7950-4d29-bbb0-6623a3f97cd3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-ef4364d0-7950-4d29-bbb0-6623a3f97cd3-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:10 devstack sudo[100863]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.536s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:07:10 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w Sep 07 17:07:10 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "cinder-quobyte-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-quobyte-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7cf2b3-0fe5-4359-9f53-a486d35ec78e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:10 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 Sep 07 17:07:10 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:10 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w" returned: 0 in 0.645s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:10 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w Sep 07 17:07:10 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:11 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:11 devstack sudo[100879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3 Sep 07 17:07:11 devstack sudo[100879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:11 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w" returned: 1 in 0.432s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_jopyxc1w' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb155cfe-f535-4f37-8953-f35916cb28a3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:11 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD Sep 07 17:07:11 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:11 devstack sudo[100879]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-quobyte-ef4364d0-7950-4d29-bbb0-6623a3f97cd3" released by "delete_volume" :: held 0.975s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Created reservations ['4c771c08-ca8e-4156-bd11-4c017dc3be07', '8c8094df-0dc1-4003-b9d8-4981cacf0bdb', '1a5a6b89-35b3-404a-aa6b-00795daa3d2a', '58516d74-8c53-4432-b947-1b28d5244c01'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:11 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] 77b14ba4-a343-4bd3-897b-c62c1df35519 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:11 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 Sep 07 17:07:11 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:11 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:11 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:11 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Deleted volume successfully. Sep 07 17:07:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2125d4be-eaef-42b6-b748-54b182c542be tempest-VolumesTransfersV355Test-732621260 None] Lock "cinder-ef4364d0-7950-4d29-bbb0-6623a3f97cd3-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:14 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4" returned: 0 in 2.683s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_zz27rdacdevstack@QuobyteHD, size 112.00 MB, duration 2.68 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:07:14 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Converted 112.00 MB image at 41.73 MB/s Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:14 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1G Sep 07 17:07:14 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:14 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 1G" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Downloaded image 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume 079a3501-dec5-4458-9b82-773ab30652e4 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 for user 1328b268724d408e837244f07c892acc is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Marking volume 079a3501-dec5-4458-9b82-773ab30652e4 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Copying metadata from image 77b14ba4-a343-4bd3-897b-c62c1df35519 to 079a3501-dec5-4458-9b82-773ab30652e4. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Creating volume glance metadata for volume 079a3501-dec5-4458-9b82-773ab30652e4 backed by image 77b14ba4-a343-4bd3-897b-c62c1df35519 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (934ea313-97f1-4aef-bda3-7d8a9ac2ee16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-079a3501-dec5-4458-9b82-773ab30652e4', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57205a8a-2226-42d4-b3c3-5b7304fdc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Volume volume-079a3501-dec5-4458-9b82-773ab30652e4 (079a3501-dec5-4458-9b82-773ab30652e4): created successfully Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57205a8a-2226-42d4-b3c3-5b7304fdc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (51f07220-84a5-4142-94ce-af822675b683) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a32a8449-e9c2-40ea-bdaf-6a29d78ea87d tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (588926f6-f4a0-4912-9124-c0b3129a2974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a45ca0-7ded-4b74-a03c-613266697e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a45ca0-7ded-4b74-a03c-613266697e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1172706309',display_name='tempest-VolumesGetTest-Volume-274579856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4815fd7-df30-4fcc-9af5-02d123263082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:17Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c34e10-fcad-4b2a-9769-f2b22303b1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c34e10-fcad-4b2a-9769-f2b22303b1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146f5b12-810b-4f8b-86b6-e8e2b53f34d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146f5b12-810b-4f8b-86b6-e8e2b53f34d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4815fd7-df30-4fcc-9af5-02d123263082', 'volume_name': 'volume-e4815fd7-df30-4fcc-9af5-02d123263082', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743aa72d-a270-4f40-aac5-8613def7b6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (743aa72d-a270-4f40-aac5-8613def7b6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cbbea7-83c8-49c5-a9ac-51a917a42b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Volume e4815fd7-df30-4fcc-9af5-02d123263082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4815fd7-df30-4fcc-9af5-02d123263082', 'volume_size': 1} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:16Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1172706309',display_name='tempest-VolumesGetTest-Volume-274579856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4815fd7-df30-4fcc-9af5-02d123263082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd10986d7dd74e12a68174afcb92da23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:17Z,use_quota=True,user_id='1328b268724d408e837244f07c892acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Creating volume e4815fd7-df30-4fcc-9af5-02d123263082 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:16 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 1073741824 Sep 07 17:07:16 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:17 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 1073741824" returned: 0 in 0.627s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:17 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 Sep 07 17:07:17 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:17 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51cbbea7-83c8-49c5-a9ac-51a917a42b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4815fd7-df30-4fcc-9af5-02d123263082', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa7c25e-cb1b-4c3f-bb66-68d1a5f5cb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Volume volume-e4815fd7-df30-4fcc-9af5-02d123263082 (e4815fd7-df30-4fcc-9af5-02d123263082): created successfully Sep 07 17:07:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eaa7c25e-cb1b-4c3f-bb66-68d1a5f5cb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Flow 'volume_create_manager' (588926f6-f4a0-4912-9124-c0b3129a2974) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ffc15bd8-86eb-4370-8ca6-94499402378f tempest-VolumesGetTest-966375200 None] Created volume successfully. Sep 07 17:07:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-e4815fd7-df30-4fcc-9af5-02d123263082-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "cinder-e4815fd7-df30-4fcc-9af5-02d123263082-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-e4815fd7-df30-4fcc-9af5-02d123263082" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-e4815fd7-df30-4fcc-9af5-02d123263082" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e3f385-00ea-44a4-b46f-2c58c6040db2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:19 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 Sep 07 17:07:19 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:19 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:19 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082 Sep 07 17:07:19 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:19 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e4815fd7-df30-4fcc-9af5-02d123263082" returned: 0 in 0.332s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-e4815fd7-df30-4fcc-9af5-02d123263082" released by "delete_volume" :: held 0.841s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Created reservations ['2df4403a-9ebc-4651-b480-2fdab38ae816', '3622b734-28ae-4f56-a519-56e4107444e8', 'e994f076-762e-4811-a7f1-210d5f2bb7fb', '7f946b79-f2f3-415e-82d7-0e5c832aa923'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:20 devstack sudo[100927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:20 devstack sudo[100927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-079a3501-dec5-4458-9b82-773ab30652e4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "cinder-079a3501-dec5-4458-9b82-773ab30652e4-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Acquiring lock "cinder-quobyte-079a3501-dec5-4458-9b82-773ab30652e4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:20 devstack sudo[100927]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-079a3501-dec5-4458-9b82-773ab30652e4" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e64e29f-3136-4e32-b56c-f26f25cc4043]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-933f46b7-adfd-4031-8510-545170f9cf2e tempest-VolumesGetTest-966375200 None] Lock "cinder-e4815fd7-df30-4fcc-9af5-02d123263082-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:20 devstack sudo[100930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 Sep 07 17:07:20 devstack sudo[100930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:21 devstack sudo[100930]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:21 devstack sudo[100935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4 Sep 07 17:07:21 devstack sudo[100935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:21 devstack sudo[100935]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-079a3501-dec5-4458-9b82-773ab30652e4" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "cinder-quobyte-079a3501-dec5-4458-9b82-773ab30652e4" released by "delete_volume" :: held 0.862s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Created reservations ['4beeefa6-9636-4c36-988c-6e3755f18ba7', '2b7cc67e-30b1-4d7b-8c9a-e0cd3939b0ea', '4665b69c-602a-4ac0-b3e4-fb56c0bf21f3', 'fea63d34-5a9c-4b39-8fad-abacc694a0e8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:21 devstack sudo[100938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:21 devstack sudo[100938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:21 devstack sudo[100938]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Deleted volume successfully. Sep 07 17:07:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c2aa72f-9889-431f-809d-b4919d7b9481 tempest-VolumesGetTest-966375200 None] Lock "cinder-079a3501-dec5-4458-9b82-773ab30652e4-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Flow 'volume_create_manager' (dffa5042-87c6-477f-9b6d-60d760d7756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2174eac8-de1f-4856-bc2e-26c6905815a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2174eac8-de1f-4856-bc2e-26c6905815a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1776385211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6891932f-31b2-4dc1-8715-a4934b1275c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0589f07f71e54be3a5f599ffb60a9109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:28Z,use_quota=True,user_id='925ded4b9edc4b4f94246af64569639c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d33393-01c2-4059-a20e-f19feb8b76dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70d33393-01c2-4059-a20e-f19feb8b76dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8278e-1833-4e76-839d-8c4e4558bd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca8278e-1833-4e76-839d-8c4e4558bd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6891932f-31b2-4dc1-8715-a4934b1275c0', 'volume_name': 'volume-6891932f-31b2-4dc1-8715-a4934b1275c0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd30dee-4a27-4929-809b-c1123f3bf414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdd30dee-4a27-4929-809b-c1123f3bf414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454219d4-c4a7-4f32-8b3a-461b3798adb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Volume 6891932f-31b2-4dc1-8715-a4934b1275c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6891932f-31b2-4dc1-8715-a4934b1275c0', 'volume_size': 1} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1776385211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6891932f-31b2-4dc1-8715-a4934b1275c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0589f07f71e54be3a5f599ffb60a9109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:28Z,use_quota=True,user_id='925ded4b9edc4b4f94246af64569639c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Creating volume 6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:27 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 1073741824 Sep 07 17:07:27 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:28 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 1073741824" returned: 0 in 0.615s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:28 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:28 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:28 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454219d4-c4a7-4f32-8b3a-461b3798adb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6891932f-31b2-4dc1-8715-a4934b1275c0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9ddec5-0546-45fe-aad0-036ca01e8242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Volume volume-6891932f-31b2-4dc1-8715-a4934b1275c0 (6891932f-31b2-4dc1-8715-a4934b1275c0): created successfully Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c9ddec5-0546-45fe-aad0-036ca01e8242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Flow 'volume_create_manager' (dffa5042-87c6-477f-9b6d-60d760d7756e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce48930f-6dd0-4018-a66c-5c49a7e102cd tempest-VolumesCloneTest-2102051889 None] Created volume successfully. Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Flow 'volume_create_manager' (54ee1121-e097-44fa-8bce-d62ddc17d140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e35e26-1b43-41c0-a002-53071bb081d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5e35e26-1b43-41c0-a002-53071bb081d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2057650639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f11b55-c62e-4f9b-bbe9-cbf05d54d777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbefcb3a0c014991abcc31351dab5c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:30Z,use_quota=True,user_id='0094981b9223409eafc69a3ed2e544ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6bcbfd-fa61-439e-86a4-7ced5bb95521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f6bcbfd-fa61-439e-86a4-7ced5bb95521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae77e7b2-d891-4784-a9d3-2d10c3c0a682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae77e7b2-d891-4784-a9d3-2d10c3c0a682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7f11b55-c62e-4f9b-bbe9-cbf05d54d777', 'volume_name': 'volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd3cb58-82af-4fb4-b59a-f005abece464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd3cb58-82af-4fb4-b59a-f005abece464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e068740e-f1b3-4e32-b4d9-84d6318a1e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777', 'volume_size': 1} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2057650639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7f11b55-c62e-4f9b-bbe9-cbf05d54d777,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dbefcb3a0c014991abcc31351dab5c91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:30Z,use_quota=True,user_id='0094981b9223409eafc69a3ed2e544ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Creating volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:29 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 1073741824 Sep 07 17:07:29 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:30 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 1073741824" returned: 0 in 0.721s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Flow 'volume_create_manager' (4ed7dd1d-80ee-4bb1-b1b1-0ff044153198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a313e-e6d1-4f12-a962-e61c54c9f2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857a313e-e6d1-4f12-a962-e61c54c9f2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1743808263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73bf8037-da24-4102-b98c-eb379cc7af18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0589f07f71e54be3a5f599ffb60a9109',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:30Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=6891932f-31b2-4dc1-8715-a4934b1275c0,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:30Z,use_quota=True,user_id='925ded4b9edc4b4f94246af64569639c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:30 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 Sep 07 17:07:30 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10422927-a877-4a68-a402-4ebd9c5efa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10422927-a877-4a68-a402-4ebd9c5efa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e8ede9-685f-4483-b8a3-12c527caf18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29e8ede9-685f-4483-b8a3-12c527caf18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '73bf8037-da24-4102-b98c-eb379cc7af18', 'volume_name': 'volume-73bf8037-da24-4102-b98c-eb379cc7af18', 'volume_size': 2, 'source_volid': '6891932f-31b2-4dc1-8715-a4934b1275c0', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3700e04e-b016-4d37-999f-47423ecd31d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3700e04e-b016-4d37-999f-47423ecd31d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0766a1ce-8c68-4f75-a7a8-16fd2bea6fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Volume 73bf8037-da24-4102-b98c-eb379cc7af18: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-73bf8037-da24-4102-b98c-eb379cc7af18', 'volume_size': 2, 'source_volid': '6891932f-31b2-4dc1-8715-a4934b1275c0', 'source_volstatus': 'available'} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:30 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] <== create_volume: return (1250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.253s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.193s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Cloning volume 6891932f-31b2-4dc1-8715-a4934b1275c0 to volume 73bf8037-da24-4102-b98c-eb379cc7af18 Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e068740e-f1b3-4e32-b4d9-84d6318a1e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2ba174-1bab-4541-890f-846e4b56373e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Volume volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 (a7f11b55-c62e-4f9b-bbe9-cbf05d54d777): created successfully Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e2ba174-1bab-4541-890f-846e4b56373e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Flow 'volume_create_manager' (54ee1121-e097-44fa-8bce-d62ddc17d140) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Creating offline snapshot 7aa9d4d5-7e30-4364-853b-22586b2157b8 of volume 6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:07:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e51e4077-9d01-4e50-996f-46b0ac2c6166 tempest-VolumesSnapshotListTestJSON-506903650 None] Created volume successfully. Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Flow 'volume_create_manager' (48fb4857-cea4-4154-883b-618b89423030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f832c32-e2e6-45a0-bb7d-d1f1c5777f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7373883-7efc-4fb4-85b2-5e8bc2b6dd35]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f832c32-e2e6-45a0-bb7d-d1f1c5777f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-313303947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a12f3-c2e2-460a-88ce-874c0ce481f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414bbd1ae1da42f691ffcea0a009980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:31Z,use_quota=True,user_id='a169d0d7f9734a8ba86c4ecc296cd6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023410-a6cc-4d67-bdc0-112220958d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db023410-a6cc-4d67-bdc0-112220958d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f8c39-9d05-4c47-8518-7b656d3150f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0f8c39-9d05-4c47-8518-7b656d3150f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786a12f3-c2e2-460a-88ce-874c0ce481f9', 'volume_name': 'volume-786a12f3-c2e2-460a-88ce-874c0ce481f9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae62ed1f-d21a-478a-8def-c7db2485ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae62ed1f-d21a-478a-8def-c7db2485ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cd0325-a674-40ee-b831-742936967e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Volume 786a12f3-c2e2-460a-88ce-874c0ce481f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786a12f3-c2e2-460a-88ce-874c0ce481f9', 'volume_size': 1} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:31 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:31 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:31 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:31 devstack sudo[100966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 1G Sep 07 17:07:31 devstack sudo[100966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Flow 'volume_create_manager' (6a50a7c4-dc4d-4512-a1d3-996f744f93e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8c5f3f-055a-4634-a420-6ce44ed4f941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f8c5f3f-055a-4634-a420-6ce44ed4f941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-651655420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c538e209-ac00-47ba-a332-493e59f78d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7415f6d238434779b35c52b7a2da2850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:32Z,use_quota=True,user_id='691d8bf7f57d4b538a211d5af15677a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54e95d-5df8-425a-9ce0-7daa66f4735c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54e95d-5df8-425a-9ce0-7daa66f4735c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6ba06c-aa94-44c6-8ad3-038c058d2b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:31 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:32 devstack sudo[100966]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 1G" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6891932f-31b2-4dc1-8715-a4934b1275c0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:32 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6891932f-31b2-4dc1-8715-a4934b1275c0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:32 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d6ba06c-aa94-44c6-8ad3-038c058d2b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c538e209-ac00-47ba-a332-493e59f78d93', 'volume_name': 'volume-c538e209-ac00-47ba-a332-493e59f78d93', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686d94e4-8024-4c92-8d33-e36c3a5b5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686d94e4-8024-4c92-8d33-e36c3a5b5002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da352ebc-d215-44c1-b040-29f94639085e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Volume c538e209-ac00-47ba-a332-493e59f78d93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c538e209-ac00-47ba-a332-493e59f78d93', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Trying to clone c538e209-ac00-47ba-a332-493e59f78d93 from image 77b14ba4-a343-4bd3-897b-c62c1df35519 at location (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:07:32 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6891932f-31b2-4dc1-8715-a4934b1275c0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.315s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 is being set with open permissions: ugo+rw Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:32 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:32 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:07:32 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Image download 20.69 MB at 20.69 MB/s Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[71996367-841c-4ec4-96c7-c5c1d766e993]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:32 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:32 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info Sep 07 17:07:32 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:32 devstack sudo[100983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD Sep 07 17:07:32 devstack sudo[100983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:32 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info is being set with open permissions: ugo+rw Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:32 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info Sep 07 17:07:32 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:32 devstack sudo[100983]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:32 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 is fetched for user 691d8bf7f57d4b538a211d5af15677a0. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[25be30f3-63e6-4b4b-8739-476e81693e5b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:33 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD Sep 07 17:07:33 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:33 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.info" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] snapshot: 7aa9d4d5-7e30-4364-853b-22586b2157b8, volume: 73bf8037-da24-4102-b98c-eb379cc7af18, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c1a55-7096-460d-929a-378095844f7a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:33 devstack sudo[100996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:33 devstack sudo[100996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:33 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:33 devstack sudo[100996]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6891932f-31b2-4dc1-8715-a4934b1275c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fb6196-6153-49bf-8ae1-3818515eea3b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:33 devstack sudo[101004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:33 devstack sudo[101004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:33 devstack sudo[101004]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:07:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:34 devstack sudo[101009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 Sep 07 17:07:34 devstack sudo[101009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:38 devstack sudo[101009]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18" returned: 0 in 4.054s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0, size 1024.00 MB, duration 4.06 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:07:38 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Converted 1024.00 MB image at 252.51 MB/s Sep 07 17:07:38 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 is being set with open permissions: ugo+rw Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:38 devstack sudo[101023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 Sep 07 17:07:38 devstack sudo[101023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:38 devstack sudo[101023]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" released by "_copy_volume_from_snapshot" :: held 5.071s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-quobyte-7aa9d4d5-7e30-4364-853b-22586b2157b8" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-7aa9d4d5-7e30-4364-853b-22586b2157b8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Deleting offline snapshot 7aa9d4d5-7e30-4364-853b-22586b2157b8 of volume 6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] snapshot_file for this snap is: volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[324916f3-a541-483e-b7ac-4808a7ec235e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:38 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:38 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:38 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.364s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6891932f-31b2-4dc1-8715-a4934b1275c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3854b017-4234-4b10-8714-0bc3f06a466b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:38 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:38 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:39 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.503s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:39 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:39 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:39 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:39 devstack sudo[101077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8 Sep 07 17:07:39 devstack sudo[101077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:39 devstack sudo[101077]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0.7aa9d4d5-7e30-4364-853b-22586b2157b8" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-7aa9d4d5-7e30-4364-853b-22586b2157b8" released by "_delete_snapshot" :: held 1.523s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.889s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.661s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-313303947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786a12f3-c2e2-460a-88ce-874c0ce481f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414bbd1ae1da42f691ffcea0a009980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:31Z,use_quota=True,user_id='a169d0d7f9734a8ba86c4ecc296cd6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Creating volume 786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:39 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:39 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 1073741824 Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0766a1ce-8c68-4f75-a7a8-16fd2bea6fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73bf8037-da24-4102-b98c-eb379cc7af18', 'volume_size': 2, 'source_volid': '6891932f-31b2-4dc1-8715-a4934b1275c0', 'source_volstatus': 'available'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:39 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38440a3-d5f6-4a74-a61e-bc9792f9cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:39 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Volume volume-73bf8037-da24-4102-b98c-eb379cc7af18 (73bf8037-da24-4102-b98c-eb379cc7af18): created successfully Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e38440a3-d5f6-4a74-a61e-bc9792f9cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Flow 'volume_create_manager' (4ed7dd1d-80ee-4bb1-b1b1-0ff044153198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-395f67fe-821c-4987-81ca-c9a6bb2fc425 tempest-VolumesCloneTest-2102051889 None] Created volume successfully. Sep 07 17:07:40 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 1073741824" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=115,cinder:DELETE=14,cinder:SELECT=80,cinder:INSERT=41 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:40 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:40 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-73bf8037-da24-4102-b98c-eb379cc7af18-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-73bf8037-da24-4102-b98c-eb379cc7af18-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1983560a-dc8c-4604-ac48-cc666395ecd3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:40 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.691s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Creating offline snapshot c1b8908a-424b-4e50-b73f-15f8c8173be7 of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9cd0325-a674-40ee-b831-742936967e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786a12f3-c2e2-460a-88ce-874c0ce481f9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a36b9fc-d780-4e5c-89d5-1884733e6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ac362d-1ba8-4098-9668-e11172855b90]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Volume volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 (786a12f3-c2e2-460a-88ce-874c0ce481f9): created successfully Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a36b9fc-d780-4e5c-89d5-1884733e6546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Flow 'volume_create_manager' (48fb4857-cea4-4154-883b-618b89423030) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc211e85-f42c-4e94-93a2-e467bd17daf6 tempest-SnapshotDependencyTests-1775871976 None] Created volume successfully. Sep 07 17:07:40 devstack sudo[101089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 Sep 07 17:07:40 devstack sudo[101089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:40 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 Sep 07 17:07:40 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:41 devstack sudo[101089]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18 Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 1G Sep 07 17:07:41 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:41 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73bf8037-da24-4102-b98c-eb379cc7af18" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-73bf8037-da24-4102-b98c-eb379cc7af18" released by "delete_volume" :: held 0.740s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Created reservations ['76d07707-6932-4083-b829-9ec9e7f1132e', 'cd1b4218-c4c0-4c1e-94e2-b1c0ab49a6a7', 'b64b8dbc-8b02-4a96-a741-5afb388d548e', 'fb940216-4af3-4eb0-91c6-88c5b7d6fc87'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:41 devstack sudo[101108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:41 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 1G" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:07:41 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:41 devstack sudo[101108]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Deleted volume successfully. Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-42f44a64-7a65-46ee-b01e-d9d91feffe69 tempest-VolumesCloneTest-2102051889 None] Lock "cinder-73bf8037-da24-4102-b98c-eb379cc7af18-delete_volume" released by "delete_volume" :: held 1.221s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-6891932f-31b2-4dc1-8715-a4934b1275c0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "cinder-6891932f-31b2-4dc1-8715-a4934b1275c0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Acquiring lock "cinder-quobyte-6891932f-31b2-4dc1-8715-a4934b1275c0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-6891932f-31b2-4dc1-8715-a4934b1275c0" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe21804-5374-4c86-ba8f-20af89f4df33]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:41 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 is being set with open permissions: ugo+rw Sep 07 17:07:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:41 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:07:41 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack sudo[101117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:42 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=93,cinder:INSERT=26,cinder:UPDATE=118,cinder:DELETE=7 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:07:42 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:42 devstack sudo[101122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info Sep 07 17:07:42 devstack sudo[101122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:42 devstack sudo[101127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0 Sep 07 17:07:42 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack sudo[101122]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:42 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info is being set with open permissions: ugo+rw Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:42 devstack sudo[101130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info Sep 07 17:07:42 devstack sudo[101130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6891932f-31b2-4dc1-8715-a4934b1275c0" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "cinder-quobyte-6891932f-31b2-4dc1-8715-a4934b1275c0" released by "delete_volume" :: held 0.787s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Created reservations ['186de89f-4809-41e0-b354-15d3c01d20ea', '763eccf4-415e-44e6-8ce6-5ad9ec7a91f7', '6117bfd3-c6d3-44e6-8b37-5ba522d1bc07', '29988a2a-f61e-4487-8e82-a5c98213db05'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:42 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:42 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack sudo[101130]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.info" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.155s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.445s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-651655420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c538e209-ac00-47ba-a332-493e59f78d93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7415f6d238434779b35c52b7a2da2850',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:32Z,use_quota=True,user_id='691d8bf7f57d4b538a211d5af15677a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Creating volume c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:42 devstack sudo[101136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1073741824 Sep 07 17:07:42 devstack sudo[101136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7e90df36-6a4e-4084-983a-b1c67f2cb078 tempest-VolumesSnapshotListTestJSON-506903650 None] Create snapshot completed successfully Sep 07 17:07:43 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Deleted volume successfully. Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-40e8a434-9324-4394-99f2-d70ca3787cde tempest-VolumesCloneTest-2102051889 None] Lock "cinder-6891932f-31b2-4dc1-8715-a4934b1275c0-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:43 devstack sudo[101136]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1073741824" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:43 devstack sudo[101143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 Sep 07 17:07:43 devstack sudo[101143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:43 devstack sudo[101143]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.443s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Creating offline snapshot cd5459e9-6ac9-48f1-9339-4e25c3482e65 of volume 786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Attempting download of 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume c538e209-ac00-47ba-a332-493e59f78d93. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c71f50-8d86-4578-8aba-35bb4d017c32]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd76c2a-3f46-4be1-aace-c4778c2370e0]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:43 devstack sudo[101146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:43 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:43 devstack sudo[101147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5 Sep 07 17:07:43 devstack sudo[101147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:44 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:44 devstack sudo[101147]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5" returned: 0 in 0.380s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:44 devstack sudo[101157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 1G Sep 07 17:07:44 devstack sudo[101157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:44 devstack sudo[101158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5 Sep 07 17:07:44 devstack sudo[101158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:44 devstack sudo[101158]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5" returned: 1 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_77b14ba4-a343-4bd3-897b-c62c1df35519_ny_e2gs5' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[48365595-a948-40be-aee4-f92e3a627871]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:44 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD Sep 07 17:07:44 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:44 devstack sudo[101157]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 1G" returned: 0 in 0.607s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:44 devstack sudo[101170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:44 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:44 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] 77b14ba4-a343-4bd3-897b-c62c1df35519 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:07:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:45 devstack sudo[101175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 Sep 07 17:07:45 devstack sudo[101175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:45 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.323s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 is being set with open permissions: ugo+rw Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:45 devstack sudo[101180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:45 devstack sudo[101180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:45 devstack sudo[101180]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:45 devstack sudo[101186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info Sep 07 17:07:45 devstack sudo[101186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:45 devstack sudo[101186]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info is being set with open permissions: ugo+rw Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:45 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info Sep 07 17:07:45 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:45 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.info" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.250s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Creating offline snapshot 3ccffbf9-e9c4-415a-9447-3f14aebd04bf of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:07:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3c282433-2361-42c6-b97d-a112d0a11e9e tempest-SnapshotDependencyTests-1775871976 None] Create snapshot completed successfully Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[20af2569-c9bc-4d2b-9232-e47ee0f89d32]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:46 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:07:46 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:46 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:46 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf 1G Sep 07 17:07:46 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:47 devstack sudo[101175]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93" returned: 0 in 2.093s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_77b14ba4-a343-4bd3-897b-c62c1df35519_icb9nnfndevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Converted 112.00 MB image at 53.48 MB/s Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:47 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1G Sep 07 17:07:47 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:47 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf 1G" returned: 0 in 0.592s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:47 devstack sudo[101214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:07:47 devstack sudo[101214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Flow 'volume_create_manager' (068463f3-6de4-47b6-83b1-af4a6bc7cde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3b165b-43ce-40ef-b1ee-4347fd590c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac3b165b-43ce-40ef-b1ee-4347fd590c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abf69587-b1c4-4f77-b669-e3d8f94b369f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='414bbd1ae1da42f691ffcea0a009980f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cd5459e9-6ac9-48f1-9339-4e25c3482e65,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:47Z,use_quota=True,user_id='a169d0d7f9734a8ba86c4ecc296cd6ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18c61d6-bf50-4a02-bdb7-c33b907978e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c18c61d6-bf50-4a02-bdb7-c33b907978e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ef348c-22ae-4f49-82d1-b717e273607a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61ef348c-22ae-4f49-82d1-b717e273607a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'abf69587-b1c4-4f77-b669-e3d8f94b369f', 'volume_name': 'volume-abf69587-b1c4-4f77-b669-e3d8f94b369f', 'volume_size': 1, 'snapshot_id': 'cd5459e9-6ac9-48f1-9339-4e25c3482e65'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5256c0-6b81-4ee1-95e5-bc3f397c886e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5256c0-6b81-4ee1-95e5-bc3f397c886e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3338cbab-cf80-42e2-8390-33c205c5b0f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Volume abf69587-b1c4-4f77-b669-e3d8f94b369f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-abf69587-b1c4-4f77-b669-e3d8f94b369f', 'volume_size': 1, 'snapshot_id': 'cd5459e9-6ac9-48f1-9339-4e25c3482e65'} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:47 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 1G" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Downloaded image 77b14ba4-a343-4bd3-897b-c62c1df35519 ((None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}])) to volume c538e209-ac00-47ba-a332-493e59f78d93 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Temporary image 77b14ba4-a343-4bd3-897b-c62c1df35519 for user 691d8bf7f57d4b538a211d5af15677a0 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Marking volume c538e209-ac00-47ba-a332-493e59f78d93 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Copying metadata from image 77b14ba4-a343-4bd3-897b-c62c1df35519 to c538e209-ac00-47ba-a332-493e59f78d93. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Creating volume glance metadata for volume c538e209-ac00-47ba-a332-493e59f78d93 backed by image 77b14ba4-a343-4bd3-897b-c62c1df35519 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:07:47 devstack sudo[101214]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Flow 'volume_create_manager' (d2d8308e-5cc0-4e93-867d-b8ceb8dbf8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b99ec35-c88f-41dc-9400-3cf53fb9c491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.431s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:47 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf is being set with open permissions: ugo+rw Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:47 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:07:47 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b99ec35-c88f-41dc-9400-3cf53fb9c491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-648265147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d916d0c-0503-4562-9d4b-07509a5f70ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31da88f3cd54d3a8c7143d098103546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:47Z,use_quota=True,user_id='4d67211159a3424e8908c55f76670b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb65d2f-9d60-407a-a15e-c00c8bb737db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ceb65d2f-9d60-407a-a15e-c00c8bb737db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b40b75-8c8a-42e1-96ea-9cb0e4ddaeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b40b75-8c8a-42e1-96ea-9cb0e4ddaeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d916d0c-0503-4562-9d4b-07509a5f70ea', 'volume_name': 'volume-4d916d0c-0503-4562-9d4b-07509a5f70ea', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd14c1c-dd9c-46ea-9c2d-0adf6450d437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dd14c1c-dd9c-46ea-9c2d-0adf6450d437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23fe9c5-6b43-4000-9e88-97de7cbdc48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Volume 4d916d0c-0503-4562-9d4b-07509a5f70ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d916d0c-0503-4562-9d4b-07509a5f70ea', 'volume_size': 1} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da352ebc-d215-44c1-b040-29f94639085e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c538e209-ac00-47ba-a332-493e59f78d93', 'volume_size': 1, 'image_id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/77b14ba4-a343-4bd3-897b-c62c1df35519', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'db852b1140da4de39a01dddb878fc7e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '77b14ba4-a343-4bd3-897b-c62c1df35519', 'created_at': datetime.datetime(2026, 9, 7, 14, 49, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 14, 49, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/77b14ba4-a343-4bd3-897b-c62c1df35519/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65ab5f3-50d8-4dae-a706-252b2fbb044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Volume volume-c538e209-ac00-47ba-a332-493e59f78d93 (c538e209-ac00-47ba-a332-493e59f78d93): created successfully Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b65ab5f3-50d8-4dae-a706-252b2fbb044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Flow 'volume_create_manager' (6a50a7c4-dc4d-4512-a1d3-996f744f93e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c5234a92-fb71-4231-807d-366af3e79f6b tempest-TestShelveInstance-1564437632 None] Created volume successfully. Sep 07 17:07:47 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.874s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.583s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65-abf69587-b1c4-4f77-b669-e3d8f94b369f" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65-abf69587-b1c4-4f77-b669-e3d8f94b369f" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Creating volume abf69587-b1c4-4f77-b669-e3d8f94b369f from snapshot cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a2e5c0da-a8f6-4522-9573-d382237d288f tempest-VolumesSnapshotListTestJSON-506903650 None] Create snapshot completed successfully Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] snapshot: cd5459e9-6ac9-48f1-9339-4e25c3482e65, volume: abf69587-b1c4-4f77-b669-e3d8f94b369f, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5b242f-33f6-40b9-be99-808649b1c8e9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:48 devstack sudo[101225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:48 devstack sudo[101225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:48 devstack sudo[101225]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786a12f3-c2e2-460a-88ce-874c0ce481f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b130392d-3f1e-40e0-8e95-5a8a6586dfb9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:48 devstack sudo[101231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:48 devstack sudo[101231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:48 devstack sudo[101231]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:07:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:48 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f Sep 07 17:07:48 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-3f273269-bafc-4b92-ab1b-358e24bbe647 req-8d74f2f9-8006-488d-8679-e8062864b23d tempest-TestShelveInstance-1564437632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:54 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f" returned: 0 in 5.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9, size 1024.00 MB, duration 5.34 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:07:54 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Converted 1024.00 MB image at 191.83 MB/s Sep 07 17:07:54 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f is being set with open permissions: ugo+rw Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:54 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f Sep 07 17:07:54 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:54 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" released by "_copy_volume_from_snapshot" :: held 6.578s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65-abf69587-b1c4-4f77-b669-e3d8f94b369f" released by "_create_volume_from_snapshot" :: held 6.650s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.676s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.898s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:07:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-648265147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d916d0c-0503-4562-9d4b-07509a5f70ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e31da88f3cd54d3a8c7143d098103546',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:07:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:07:47Z,use_quota=True,user_id='4d67211159a3424e8908c55f76670b72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Creating volume 4d916d0c-0503-4562-9d4b-07509a5f70ea {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:07:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:54 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea 1073741824 Sep 07 17:07:54 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3338cbab-cf80-42e2-8390-33c205c5b0f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abf69587-b1c4-4f77-b669-e3d8f94b369f', 'volume_size': 1, 'snapshot_id': 'cd5459e9-6ac9-48f1-9339-4e25c3482e65'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3198152a-a2d4-42d8-bbdc-9123a12bd5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Volume volume-abf69587-b1c4-4f77-b669-e3d8f94b369f (abf69587-b1c4-4f77-b669-e3d8f94b369f): created successfully Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3198152a-a2d4-42d8-bbdc-9123a12bd5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Flow 'volume_create_manager' (068463f3-6de4-47b6-83b1-af4a6bc7cde3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d6ec0728-312d-4a85-8fea-7341653e4273 tempest-SnapshotDependencyTests-1775871976 None] Created volume successfully. Sep 07 17:07:55 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea 1073741824" returned: 0 in 0.507s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-cd5459e9-6ac9-48f1-9339-4e25c3482e65-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:55 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea Sep 07 17:07:55 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-cd5459e9-6ac9-48f1-9339-4e25c3482e65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Deleting offline snapshot cd5459e9-6ac9-48f1-9339-4e25c3482e65 of volume 786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] snapshot_file for this snap is: volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0491cc-fb92-4bef-a356-d9737ddd957d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:55 devstack sudo[101279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:55 devstack sudo[101279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:55 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea" returned: 0 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.187s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23fe9c5-6b43-4000-9e88-97de7cbdc48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d916d0c-0503-4562-9d4b-07509a5f70ea', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943587c2-72f9-41c3-879d-0c191cc1a1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Creating offline snapshot 5262952e-cf40-4a99-b41f-78f9581599ad of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb66912-7296-4a5d-a49d-0f9815ee9eb1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Volume volume-4d916d0c-0503-4562-9d4b-07509a5f70ea (4d916d0c-0503-4562-9d4b-07509a5f70ea): created successfully Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (943587c2-72f9-41c3-879d-0c191cc1a1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Flow 'volume_create_manager' (d2d8308e-5cc0-4e93-867d-b8ceb8dbf8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:07:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1dbb97dc-c01c-490a-b37b-6f286cb304a9 tempest-VolumesNegativeTest-1783036112 None] Created volume successfully. Sep 07 17:07:55 devstack sudo[101279]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-786a12f3-c2e2-460a-88ce-874c0ce481f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:55 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:07:55 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[081a701e-509b-46cf-bcec-35214022e019]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:55 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:55 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:56 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.474s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:56 devstack sudo[101294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad 1G Sep 07 17:07:56 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:56 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.616s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:56 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:56 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:56 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad 1G" returned: 0 in 0.588s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:56 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad Sep 07 17:07:56 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:56 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:56 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65 Sep 07 17:07:56 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:56 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad" returned: 0 in 0.332s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:56 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad is being set with open permissions: ugo+rw Sep 07 17:07:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:56 devstack sudo[101316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad Sep 07 17:07:56 devstack sudo[101316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:57 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9.cd5459e9-6ac9-48f1-9339-4e25c3482e65" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-cd5459e9-6ac9-48f1-9339-4e25c3482e65" released by "_delete_snapshot" :: held 1.884s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" released by "delete_snapshot" :: held 1.919s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Created reservations ['665c4678-19c8-48bd-b4cc-0ad055956f00', '2f6f33e2-23e8-4bf4-98ef-0d797399498a', 'edb5074e-7e76-46f1-ac1a-64f3fb66f0df', '4758b431-1ef0-49c2-a874-aaaca9308d22'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:57 devstack sudo[101316]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-3f273269-bafc-4b92-ab1b-358e24bbe647 req-8d74f2f9-8006-488d-8679-e8062864b23d tempest-TestShelveInstance-1564437632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.205s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-3f273269-bafc-4b92-ab1b-358e24bbe647 req-8d74f2f9-8006-488d-8679-e8062864b23d tempest-TestShelveInstance-1564437632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Delete snapshot completed successfully. Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc8342fd-40cd-4cc6-bd05-9226afa374cc tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-cd5459e9-6ac9-48f1-9339-4e25c3482e65-delete_snapshot" released by "delete_snapshot" :: held 2.227s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6ed4b994-6c98-40af-8266-36363e6909a5 tempest-VolumesSnapshotListTestJSON-506903650 None] Create snapshot completed successfully Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-786a12f3-c2e2-460a-88ce-874c0ce481f9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-3f273269-bafc-4b92-ab1b-358e24bbe647 req-8d74f2f9-8006-488d-8679-e8062864b23d tempest-TestShelveInstance-1564437632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-c538e209-ac00-47ba-a332-493e59f78d93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9e35ae54-cb67-4819-81a2-3a58026b6943', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-786a12f3-c2e2-460a-88ce-874c0ce481f9-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-3f273269-bafc-4b92-ab1b-358e24bbe647 req-8d74f2f9-8006-488d-8679-e8062864b23d tempest-TestShelveInstance-1564437632 None] attachment_update completed successfully. Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf050bb-bbc5-4c3c-ac3a-482cf9739b96]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:57 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:57 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:58 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:58 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9 Sep 07 17:07:58 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:58 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-786a12f3-c2e2-460a-88ce-874c0ce481f9" returned: 0 in 0.643s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-786a12f3-c2e2-460a-88ce-874c0ce481f9" released by "delete_volume" :: held 1.248s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Created reservations ['677788d7-2323-4d34-bc05-4a07ecb48d1f', 'c211b254-069a-4aad-b94b-9e911dc5d18f', '1286120c-da8a-43b9-915e-55c172579155', 'a969bd94-a713-4068-82db-ec0dd0ddd34f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:59 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:07:59 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-5262952e-cf40-4a99-b41f-78f9581599ad-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-5262952e-cf40-4a99-b41f-78f9581599ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-5262952e-cf40-4a99-b41f-78f9581599ad" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-5262952e-cf40-4a99-b41f-78f9581599ad" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Deleting offline snapshot 5262952e-cf40-4a99-b41f-78f9581599ad of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] snapshot_file for this snap is: volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58223e-4b5a-4e15-914a-ba565e1ae4a3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:07:59 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.759s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:07:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Deleted volume successfully. Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-137628ad-77cf-4ca7-a18a-5ab7856c5e9e tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-786a12f3-c2e2-460a-88ce-874c0ce481f9-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:07:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-abf69587-b1c4-4f77-b669-e3d8f94b369f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-abf69587-b1c4-4f77-b669-e3d8f94b369f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:00 devstack sudo[101771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad Sep 07 17:08:00 devstack sudo[101771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a6bc89-1e83-4693-9f94-69772b2288cd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:00 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f Sep 07 17:08:00 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:00 devstack sudo[101771]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad" returned: 0 in 1.007s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df0f0b5-7477-4923-b365-7f0e2b1b10a1]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:00 devstack sudo[101799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:08:00 devstack sudo[101799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:01 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f" returned: 0 in 0.787s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:01 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f Sep 07 17:08:01 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:01 devstack sudo[101799]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.770s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:01 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad Sep 07 17:08:01 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:01 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-abf69587-b1c4-4f77-b669-e3d8f94b369f" returned: 0 in 0.571s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-quobyte-abf69587-b1c4-4f77-b669-e3d8f94b369f" released by "delete_volume" :: held 1.448s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Created reservations ['4362c746-2ca2-4210-9c12-e581c16f519e', '1960bc3b-2280-4699-b4ef-c8ad9b05b7aa', '558a4332-6ce6-4a3f-a9d0-0a3e9c8d1c74', '8576d6e7-6546-4537-8866-310b74c8a498'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:01 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:08:01 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:02 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.369s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:08:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Deleted volume successfully. Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a122156-8d4a-401b-9fbc-90bdf51e37b2 tempest-SnapshotDependencyTests-1775871976 None] Lock "cinder-abf69587-b1c4-4f77-b669-e3d8f94b369f-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:02 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad" returned: 0 in 0.975s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:02 devstack sudo[101822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad Sep 07 17:08:02 devstack sudo[101822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:02 devstack sudo[101822]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.5262952e-cf40-4a99-b41f-78f9581599ad" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-5262952e-cf40-4a99-b41f-78f9581599ad" released by "_delete_snapshot" :: held 3.420s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" released by "delete_snapshot" :: held 3.451s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Created reservations ['8eea6116-14b6-48e1-9ad4-af1de7b539ef', 'cc2d23ae-bd92-44cd-bc24-3512ca018fe1', '9206f7da-b792-44a3-a9d2-ac6de349eee7', '32489ff3-f85b-48e5-abfc-1c70f7eb305f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Delete snapshot completed successfully. Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9ba296ee-4fad-47c8-a10b-85b5849f455a tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-5262952e-cf40-4a99-b41f-78f9581599ad-delete_snapshot" released by "delete_snapshot" :: held 3.719s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-3ccffbf9-e9c4-415a-9447-3f14aebd04bf-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-3ccffbf9-e9c4-415a-9447-3f14aebd04bf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-3ccffbf9-e9c4-415a-9447-3f14aebd04bf" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-3ccffbf9-e9c4-415a-9447-3f14aebd04bf" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Deleting offline snapshot 3ccffbf9-e9c4-415a-9447-3f14aebd04bf of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] snapshot_file for this snap is: volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f294da0-e10e-4a36-91ac-8fd26130b8be]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:04 devstack sudo[101827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:08:04 devstack sudo[101827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:04 devstack sudo[101827]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.679s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7489c92-1509-4756-b8a7-b0b914bc3031]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:05 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:08:05 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:05 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.624s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:05 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:08:05 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:06 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.651s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:06 devstack sudo[101845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf Sep 07 17:08:06 devstack sudo[101845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:06 devstack sudo[101845]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.3ccffbf9-e9c4-415a-9447-3f14aebd04bf" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-3ccffbf9-e9c4-415a-9447-3f14aebd04bf" released by "_delete_snapshot" :: held 2.392s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" released by "delete_snapshot" :: held 2.434s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Created reservations ['81d35470-b036-4f8a-8b22-f1fdcdaf391d', 'e886dd20-48c7-40d2-86de-616a15348782', '02847b7c-dd1d-45d8-a63f-6c1f8a086740', '2c1b37a1-34f4-4955-a8e9-29a0889f17b8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Delete snapshot completed successfully. Sep 07 17:08:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-389ce18a-fd78-4303-aafb-f861f23893c0 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-3ccffbf9-e9c4-415a-9447-3f14aebd04bf-delete_snapshot" released by "delete_snapshot" :: held 2.684s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-c1b8908a-424b-4e50-b73f-15f8c8173be7-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-c1b8908a-424b-4e50-b73f-15f8c8173be7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-c1b8908a-424b-4e50-b73f-15f8c8173be7" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-c1b8908a-424b-4e50-b73f-15f8c8173be7" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Deleting offline snapshot c1b8908a-424b-4e50-b73f-15f8c8173be7 of volume a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] snapshot_file for this snap is: volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa4d032a-5dc8-4c10-b414-13a3d7baa432]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:07 devstack sudo[101850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:08:07 devstack sudo[101850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:08 devstack sudo[101850]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.826s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe73ee8-5eb4-443b-87f3-ebb233e289bc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:08 devstack sudo[101906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 Sep 07 17:08:08 devstack sudo[101906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:09 devstack sudo[101906]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" returned: 0 in 0.942s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:09 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:08:09 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:09 devstack sudo[101937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:08:09 devstack sudo[101937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:10 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 1.023s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:10 devstack sudo[101940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7 Sep 07 17:08:10 devstack sudo[101940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:10 devstack sudo[101937]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.793s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:08:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:08:11 devstack sudo[101940]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777.c1b8908a-424b-4e50-b73f-15f8c8173be7" returned: 0 in 0.778s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-c1b8908a-424b-4e50-b73f-15f8c8173be7" released by "_delete_snapshot" :: held 3.845s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" released by "delete_snapshot" :: held 3.879s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Created reservations ['66501e80-904d-4fc2-8cc0-18b77d6d7877', '67163e78-8a04-4ef1-b3cc-a3342e99b9ac', '4bf35924-da01-4371-9c31-88ad38e56ba5', '128d0127-33ce-43ea-8e70-77e0c4dff731'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Delete snapshot completed successfully. Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b08bd300-503d-4814-9d9a-9a3bd8cbaf78 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-c1b8908a-424b-4e50-b73f-15f8c8173be7-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f844bf-0409-4639-8342-90a7371103bb]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:12 devstack sudo[101945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 Sep 07 17:08:12 devstack sudo[101945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:12 devstack sudo[101945]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" returned: 0 in 0.769s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:13 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777 Sep 07 17:08:13 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:13 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-quobyte-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777" released by "delete_volume" :: held 1.263s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Created reservations ['c5e32c02-0e23-4ebb-9598-a99018c581f1', 'aaaef175-831b-4f27-a750-e5cebe333a50', '9f62c8e8-430d-4568-bedb-34daffe24537', '17cd653f-05f5-4228-a9b0-20cc9a18881d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:13 devstack sudo[101967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:08:13 devstack sudo[101967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:14 devstack sudo[101967]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.501s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:14 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:08:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Deleted volume successfully. Sep 07 17:08:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d8cb42bb-853c-4f2f-800e-5a6836b7ea28 tempest-VolumesSnapshotListTestJSON-506903650 None] Lock "cinder-a7f11b55-c62e-4f9b-bbe9-cbf05d54d777-delete_volume" released by "delete_volume" :: held 2.189s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:23 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=67,cinder:INSERT=27,cinder:UPDATE=64,cinder:DELETE=5 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:08:24 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=78,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=24 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:08:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Acquiring lock "cinder-4d916d0c-0503-4562-9d4b-07509a5f70ea-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "cinder-4d916d0c-0503-4562-9d4b-07509a5f70ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Acquiring lock "cinder-quobyte-4d916d0c-0503-4562-9d4b-07509a5f70ea" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "cinder-quobyte-4d916d0c-0503-4562-9d4b-07509a5f70ea" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b035f65-3e12-4a41-9131-9140343993ec]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:25 devstack sudo[102028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea Sep 07 17:08:25 devstack sudo[102028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:25 devstack sudo[102028]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:25 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea Sep 07 17:08:25 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:25 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4d916d0c-0503-4562-9d4b-07509a5f70ea" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "cinder-quobyte-4d916d0c-0503-4562-9d4b-07509a5f70ea" released by "delete_volume" :: held 0.800s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:25 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Created reservations ['33cb9c83-4f0a-4c8f-a431-3a5777e7a3a6', '052bfaec-db0e-4660-a67b-81cc516d9923', 'a5e24de2-0e77-41eb-aae7-112dd8f3534a', '3af7a049-cf1f-4406-b1b9-a5a06619a34c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:26 devstack sudo[102036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:08:26 devstack sudo[102036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:26 devstack sudo[102036]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:08:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Deleted volume successfully. Sep 07 17:08:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cdd9e433-3b14-4718-ab37-21d8b02c57aa tempest-VolumesNegativeTest-1783036112 None] Lock "cinder-4d916d0c-0503-4562-9d4b-07509a5f70ea-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:36 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=9,cinder:SELECT=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:08:36 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=2,cinder:INSERT=4,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:08:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-af455fb4-021b-4180-8f5a-f1d8bd8aed58 req-59ea9de5-7c2a-4ad3-9423-cc90d05afdad tempest-TestShelveInstance-1564437632 None] Terminate volume connection completed successfully. Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-af455fb4-021b-4180-8f5a-f1d8bd8aed58 req-59ea9de5-7c2a-4ad3-9423-cc90d05afdad tempest-TestShelveInstance-1564437632 None] Deleting attachment 9e35ae54-cb67-4819-81a2-3a58026b6943. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (eaceb9e1-beed-4f32-b91e-8be03149e5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45907b23-4c9d-4a99-a709-fa9d3314566a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45907b23-4c9d-4a99-a709-fa9d3314566a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-239408454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e6aeab-aa82-4d3b-b3c3-cc398fa370fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:44Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6286fb-da17-43bf-b645-fff1c5a12a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae6286fb-da17-43bf-b645-fff1c5a12a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653362c-3344-401e-8301-7c51f593f827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3653362c-3344-401e-8301-7c51f593f827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19e6aeab-aa82-4d3b-b3c3-cc398fa370fe', 'volume_name': 'volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2da1fdb-6357-4ccf-81e1-f26c576c1c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2da1fdb-6357-4ccf-81e1-f26c576c1c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a49dbd8-4aa4-4b9f-8313-4c9dba3f6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume 19e6aeab-aa82-4d3b-b3c3-cc398fa370fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe', 'volume_size': 1} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-239408454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19e6aeab-aa82-4d3b-b3c3-cc398fa370fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:44Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating volume 19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:44 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:44 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe 1073741824 Sep 07 17:08:44 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:44 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe 1073741824" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:44 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe Sep 07 17:08:44 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:44 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a49dbd8-4aa4-4b9f-8313-4c9dba3f6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5115ff7-a1ed-44c5-9033-c9eeea4f8f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe (19e6aeab-aa82-4d3b-b3c3-cc398fa370fe): created successfully Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5115ff7-a1ed-44c5-9033-c9eeea4f8f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (eaceb9e1-beed-4f32-b91e-8be03149e5ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-19695de8-b232-4b04-ac18-c102b5b1b353 tempest-VolumesSnapshotTestJSON-1869697952 None] Created volume successfully. Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Creating offline snapshot db650020-3770-4066-8fbb-e57d95bfabc2 of volume 19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a69f5d3c-4865-421c-bb84-2a2f5242009c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:46 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe Sep 07 17:08:46 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (714067af-8e73-4876-bf1d-c75a7227b8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c07df2-7ce9-46a7-984f-d88e36e2e021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2c07df2-7ce9-46a7-984f-d88e36e2e021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759539414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7682dd-eaf7-4da3-9dda-5e00c42d3307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:47Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0b9e43a-ed63-4a43-bd97-ad188628a32d),volume_type_id=e0b9e43a-ed63-4a43-bd97-ad188628a32d)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b6f3ed-2e73-44ea-92d8-6dd0f91a8730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b6f3ed-2e73-44ea-92d8-6dd0f91a8730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc1db6-d057-42bf-a17c-6efefb62b2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8adc1db6-d057-42bf-a17c-6efefb62b2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f7682dd-eaf7-4da3-9dda-5e00c42d3307', 'volume_name': 'volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48aa0de-739b-45ff-9717-86a765ef0fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b48aa0de-739b-45ff-9717-86a765ef0fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670569dc-39a0-49aa-9b2e-bff3dc09c5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume 6f7682dd-eaf7-4da3-9dda-5e00c42d3307: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307', 'volume_size': 1} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-779fbe26-b1d2-42bc-9b84-f7e1e66b27d5 req-3830e9c4-6289-4587-9a44-b4c19b04aeb5 tempest-TestShelveInstance-1564437632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:46 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" returned: 0 in 0.513s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:47 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 1G Sep 07 17:08:47 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (a6463f67-2e7e-4d7c-8543-edaf3016f45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144da2c3-876a-41c5-be62-ccc3073cdd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144da2c3-876a-41c5-be62-ccc3073cdd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1292483761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf449437-8c92-48c5-8a7b-37b415ba0811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:47Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16d83739-aacd-44ac-b2ba-084a57ff4dd6),volume_type_id=16d83739-aacd-44ac-b2ba-084a57ff4dd6)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8115e1b5-83e0-4b19-8097-c9761797a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8115e1b5-83e0-4b19-8097-c9761797a22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4118cb7-2ba3-4631-8cd0-d8ef1c463e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4118cb7-2ba3-4631-8cd0-d8ef1c463e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf449437-8c92-48c5-8a7b-37b415ba0811', 'volume_name': 'volume-bf449437-8c92-48c5-8a7b-37b415ba0811', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a045a9db-a74a-4073-b0e7-6451e4d519af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a045a9db-a74a-4073-b0e7-6451e4d519af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e923992-b499-4a4e-af78-7b5e201dffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume bf449437-8c92-48c5-8a7b-37b415ba0811: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf449437-8c92-48c5-8a7b-37b415ba0811', 'volume_size': 1} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:47 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 1G" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:47 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 Sep 07 17:08:47 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:47 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:47 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 is being set with open permissions: ugo+rw Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:47 devstack sudo[102152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 Sep 07 17:08:47 devstack sudo[102152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (7a2da7ea-ae92-4f08-a5e0-cf0790508d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3964a0b5-c580-4e92-9c91-9cccd2e5d4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3964a0b5-c580-4e92-9c91-9cccd2e5d4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1659117487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83551491-ad1b-445a-9321-918abb28ead9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:48Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39a941b3-c383-4508-9e27-ba20a7f394b9),volume_type_id=39a941b3-c383-4508-9e27-ba20a7f394b9)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa13922-ee5e-4372-8574-1e56b7619454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aa13922-ee5e-4372-8574-1e56b7619454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b004bfb-2297-43e3-9982-fc5a184ba4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:08:47 devstack sudo[102152]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:48 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info Sep 07 17:08:48 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b004bfb-2297-43e3-9982-fc5a184ba4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '83551491-ad1b-445a-9321-918abb28ead9', 'volume_name': 'volume-83551491-ad1b-445a-9321-918abb28ead9', 'volume_size': 1, 'image_id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--496594943', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04d84d9a6fcf4dc6a8401bf90588a18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'created_at': datetime.datetime(2026, 9, 7, 15, 8, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 8, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f70543e3-7bee-47d1-8f88-882379dda257/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cead93d1-63a2-4ab0-ae40-17e2f649892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cead93d1-63a2-4ab0-ae40-17e2f649892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c046f4e5-54be-4c51-9fc9-83b100e1cd46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume 83551491-ad1b-445a-9321-918abb28ead9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-83551491-ad1b-445a-9321-918abb28ead9', 'volume_size': 1, 'image_id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--496594943', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04d84d9a6fcf4dc6a8401bf90588a18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'created_at': datetime.datetime(2026, 9, 7, 15, 8, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 8, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f70543e3-7bee-47d1-8f88-882379dda257/file', 'properties': {}}, 'image_service': } Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Trying to clone 83551491-ad1b-445a-9321-918abb28ead9 from image f70543e3-7bee-47d1-8f88-882379dda257 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:08:48 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:48 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info is being set with open permissions: ugo+rw Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:48 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info Sep 07 17:08:48 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:48 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.info" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.700s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-759539414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f7682dd-eaf7-4da3-9dda-5e00c42d3307,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:47Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e0b9e43a-ed63-4a43-bd97-ad188628a32d),volume_type_id=e0b9e43a-ed63-4a43-bd97-ad188628a32d)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Creating volume 6f7682dd-eaf7-4da3-9dda-5e00c42d3307 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:48 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:08:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:48 devstack sudo[102161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 1073741824 Sep 07 17:08:48 devstack sudo[102161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-23c1ad09-a808-4477-9741-aa0da51c456c tempest-VolumesSnapshotTestJSON-1869697952 None] Create snapshot completed successfully Sep 07 17:08:49 devstack sudo[102161]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 1073741824" returned: 0 in 0.433s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:49 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 Sep 07 17:08:49 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:49 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-779fbe26-b1d2-42bc-9b84-f7e1e66b27d5 req-3830e9c4-6289-4587-9a44-b4c19b04aeb5 tempest-TestShelveInstance-1564437632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.417s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-779fbe26-b1d2-42bc-9b84-f7e1e66b27d5 req-3830e9c4-6289-4587-9a44-b4c19b04aeb5 tempest-TestShelveInstance-1564437632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.064s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1292483761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf449437-8c92-48c5-8a7b-37b415ba0811,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:47Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(16d83739-aacd-44ac-b2ba-084a57ff4dd6),volume_type_id=16d83739-aacd-44ac-b2ba-084a57ff4dd6)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Creating volume bf449437-8c92-48c5-8a7b-37b415ba0811 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670569dc-39a0-49aa-9b2e-bff3dc09c5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e75ef-f5d5-4e67-9674-d3bbd0c73152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:49 devstack sudo[102171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 1073741824 Sep 07 17:08:49 devstack sudo[102171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 (6f7682dd-eaf7-4da3-9dda-5e00c42d3307): created successfully Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (833e75ef-f5d5-4e67-9674-d3bbd0c73152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (714067af-8e73-4876-bf1d-c75a7227b8e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f380430a-243a-45ae-b0ba-4c8a0f0410e9 tempest-TestInstancesWithCinderVolumes-1276987584 None] Created volume successfully. Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-779fbe26-b1d2-42bc-9b84-f7e1e66b27d5 req-3830e9c4-6289-4587-9a44-b4c19b04aeb5 tempest-TestShelveInstance-1564437632 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-c538e209-ac00-47ba-a332-493e59f78d93', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '05d57900-2f01-446e-9517-e5d0c496dcfe', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:08:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-779fbe26-b1d2-42bc-9b84-f7e1e66b27d5 req-3830e9c4-6289-4587-9a44-b4c19b04aeb5 tempest-TestShelveInstance-1564437632 None] attachment_update completed successfully. Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-db650020-3770-4066-8fbb-e57d95bfabc2-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:49 devstack sudo[102171]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 1073741824" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-db650020-3770-4066-8fbb-e57d95bfabc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:50 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 Sep 07 17:08:50 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-db650020-3770-4066-8fbb-e57d95bfabc2" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-db650020-3770-4066-8fbb-e57d95bfabc2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Deleting offline snapshot db650020-3770-4066-8fbb-e57d95bfabc2 of volume 19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] snapshot_file for this snap is: volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[feaae107-b537-4978-9b10-2607b360ac07]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:50 devstack sudo[102178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 Sep 07 17:08:50 devstack sudo[102178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:50 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e923992-b499-4a4e-af78-7b5e201dffd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf449437-8c92-48c5-8a7b-37b415ba0811', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4660b3f-a0bc-44ba-b810-6f3a386ef2b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume volume-bf449437-8c92-48c5-8a7b-37b415ba0811 (bf449437-8c92-48c5-8a7b-37b415ba0811): created successfully Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4660b3f-a0bc-44ba-b810-6f3a386ef2b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (a6463f67-2e7e-4d7c-8543-edaf3016f45f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0f0ac6fd-f225-4848-944f-9e41b9bf9150 tempest-TestInstancesWithCinderVolumes-1276987584 None] Created volume successfully. Sep 07 17:08:50 devstack sudo[102178]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2" returned: 0 in 0.463s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ab9023-325c-44e4-b844-909bdd0ea531]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:50 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe Sep 07 17:08:50 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:51 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:51 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 Sep 07 17:08:51 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:51 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2" returned: 0 in 0.397s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:51 devstack sudo[102195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2 Sep 07 17:08:51 devstack sudo[102195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:51 devstack sudo[102195]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe.db650020-3770-4066-8fbb-e57d95bfabc2" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-db650020-3770-4066-8fbb-e57d95bfabc2" released by "_delete_snapshot" :: held 1.718s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" released by "delete_snapshot" :: held 1.749s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['2a2d2c93-2d80-4ed6-be45-2a1886963381', '653cc299-a1e6-4aa0-a765-d2ef072b9e8a', '51d8602e-7a59-46e0-9c7e-bfa4e8757b85', '1e68a440-0c6c-40be-90f6-7e53dc22dc06'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:08:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Delete snapshot completed successfully. Sep 07 17:08:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0ef30348-693f-4a6b-a410-0cac996db191 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-db650020-3770-4066-8fbb-e57d95bfabc2-delete_snapshot" released by "delete_snapshot" :: held 2.032s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:08:52 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD, size 20.69 MB, duration 4.26 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:08:52 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Image download 20.69 MB at 4.85 MB/s Sep 07 17:08:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84bce69-d62a-49bd-b4f5-638b62388221]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:52 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD Sep 07 17:08:52 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (8f3c49b5-2910-4768-afef-59385834192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d12b25b-0e84-4f4a-b319-6bf91e38aa0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:53 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD" returned: 0 in 0.567s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Temporary image f70543e3-7bee-47d1-8f88-882379dda257 is fetched for user ae0afa361c49499895fcf14ef6541cda. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d12b25b-0e84-4f4a-b319-6bf91e38aa0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1955431387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6446cf-5c7b-4930-8ae3-2347af7f3de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:53Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e7218e-e2e8-41b8-a870-53b92c77a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65e7218e-e2e8-41b8-a870-53b92c77a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c09ddb-7951-48a6-8d2d-2dd39afdbe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c09ddb-7951-48a6-8d2d-2dd39afdbe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a6446cf-5c7b-4930-8ae3-2347af7f3de5', 'volume_name': 'volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81aaba6-d7fe-4b12-9358-20971f429fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e81aaba6-d7fe-4b12-9358-20971f429fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bef33-e104-4c9f-94e6-cdb0b4a0c455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Volume 3a6446cf-5c7b-4930-8ae3-2347af7f3de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5', 'volume_size': 1} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1955431387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a6446cf-5c7b-4930-8ae3-2347af7f3de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:53Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Creating volume 3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:53 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 1073741824 Sep 07 17:08:53 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3763649-d5c7-4829-b584-99ebcb87a7cd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:53 devstack sudo[102638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD Sep 07 17:08:53 devstack sudo[102638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:53 devstack sudo[102638]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:54 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 1073741824" returned: 0 in 0.683s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:54 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:08:54 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:54 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1659117487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83551491-ad1b-445a-9321-918abb28ead9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d84d9a6fcf4dc6a8401bf90588a18c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:48Z,use_quota=True,user_id='ae0afa361c49499895fcf14ef6541cda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(39a941b3-c383-4508-9e27-ba20a7f394b9),volume_type_id=39a941b3-c383-4508-9e27-ba20a7f394b9)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Creating volume 83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15bef33-e104-4c9f-94e6-cdb0b4a0c455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:54 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1073741824 Sep 07 17:08:54 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0cb5ea-79fe-4387-bdf7-281a1b533721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Volume volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 (3a6446cf-5c7b-4930-8ae3-2347af7f3de5): created successfully Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc0cb5ea-79fe-4387-bdf7-281a1b533721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (8f3c49b5-2910-4768-afef-59385834192c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-34a88b80-4399-4dd6-a732-2bda7d986a8f tempest-VolumesSnapshotTestJSON-1869697952 None] Created volume successfully. Sep 07 17:08:54 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1073741824" returned: 0 in 0.582s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:54 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 Sep 07 17:08:54 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:55 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Attempting download of f70543e3-7bee-47d1-8f88-882379dda257 ((None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}])) to volume 83551491-ad1b-445a-9321-918abb28ead9. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating offline snapshot b7e0be85-9c3e-407e-892d-8d3e70b89932 of volume 3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f40b17-7146-4f67-ae64-ad9b925ec41a]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba2089c-a53d-4c33-a255-8d20706fd191]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:55 devstack sudo[102682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb Sep 07 17:08:55 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:55 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:08:55 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:55 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:55 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:55 devstack sudo[102693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 1G Sep 07 17:08:55 devstack sudo[102693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:55 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb Sep 07 17:08:55 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:56 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb" returned: 1 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f70543e3-7bee-47d1-8f88-882379dda257_ezklbiyb' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f95fe7-cf9c-4326-9e9e-f3850eb5cb54]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:56 devstack sudo[102702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD Sep 07 17:08:56 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:56 devstack sudo[102693]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 1G" returned: 0 in 0.568s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:56 devstack sudo[102704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:08:56 devstack sudo[102704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:56 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] f70543e3-7bee-47d1-8f88-882379dda257 was qcow2, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:56 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 Sep 07 17:08:56 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:56 devstack sudo[102704]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:56 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 is being set with open permissions: ugo+rw Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:56 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:08:56 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:56 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:57 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info Sep 07 17:08:57 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:57 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:57 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info is being set with open permissions: ugo+rw Sep 07 17:08:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:57 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info Sep 07 17:08:57 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:57 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.info" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.196s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f6d4e018-6ad3-41e0-b111-107bd579a0c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Create snapshot completed successfully Sep 07 17:08:58 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9" returned: 0 in 1.754s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f70543e3-7bee-47d1-8f88-882379dda257_enblvyfpdevstack@QuobyteHD, size 112.00 MB, duration 1.75 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:08:58 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Converted 112.00 MB image at 63.82 MB/s Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:58 devstack sudo[102730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1G Sep 07 17:08:58 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:58 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 1G" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Downloaded image f70543e3-7bee-47d1-8f88-882379dda257 ((None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}])) to volume 83551491-ad1b-445a-9321-918abb28ead9 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Temporary image f70543e3-7bee-47d1-8f88-882379dda257 for user ae0afa361c49499895fcf14ef6541cda is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Marking volume 83551491-ad1b-445a-9321-918abb28ead9 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Copying metadata from image f70543e3-7bee-47d1-8f88-882379dda257 to 83551491-ad1b-445a-9321-918abb28ead9. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Creating volume glance metadata for volume 83551491-ad1b-445a-9321-918abb28ead9 backed by image f70543e3-7bee-47d1-8f88-882379dda257 with: {'image_id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'image_name': 'tempest-scenario-img--496594943', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c046f4e5-54be-4c51-9fc9-83b100e1cd46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83551491-ad1b-445a-9321-918abb28ead9', 'volume_size': 1, 'image_id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f70543e3-7bee-47d1-8f88-882379dda257', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--496594943', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '04d84d9a6fcf4dc6a8401bf90588a18c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f70543e3-7bee-47d1-8f88-882379dda257', 'created_at': datetime.datetime(2026, 9, 7, 15, 8, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 8, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f70543e3-7bee-47d1-8f88-882379dda257/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a630e57-72c9-4bad-b95d-e4d042093dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Volume volume-83551491-ad1b-445a-9321-918abb28ead9 (83551491-ad1b-445a-9321-918abb28ead9): created successfully Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a630e57-72c9-4bad-b95d-e4d042093dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Flow 'volume_create_manager' (7a2da7ea-ae92-4f08-a5e0-cf0790508d0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ab6decbf-c2f7-48aa-91c2-a1bfca151427 tempest-TestInstancesWithCinderVolumes-1276987584 None] Created volume successfully. Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (a9db7a5c-9119-4ef0-bc7d-12400138189a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dfd430-1f85-429d-85aa-cfd00cdc7f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81dfd430-1f85-429d-85aa-cfd00cdc7f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-343077311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2657114d-cf3c-45a7-a5da-b4562bf2fb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:08:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=b7e0be85-9c3e-407e-892d-8d3e70b89932,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:08:59Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fb01e3-b8bb-4d5d-abbf-15aacb00556b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5fb01e3-b8bb-4d5d-abbf-15aacb00556b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91efb154-76fc-439a-b803-e3088e99fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91efb154-76fc-439a-b803-e3088e99fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2657114d-cf3c-45a7-a5da-b4562bf2fb5d', 'volume_name': 'volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d', 'volume_size': 2, 'snapshot_id': 'b7e0be85-9c3e-407e-892d-8d3e70b89932'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4637c6-d7d3-4502-a890-3fbdf5a82597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c4637c6-d7d3-4502-a890-3fbdf5a82597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237bf45a-a6e8-4377-bd5f-b620cb0866c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:08:59 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume 2657114d-cf3c-45a7-a5da-b4562bf2fb5d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d', 'volume_size': 2, 'snapshot_id': 'b7e0be85-9c3e-407e-892d-8d3e70b89932'} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating volume 2657114d-cf3c-45a7-a5da-b4562bf2fb5d from snapshot b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] snapshot: b7e0be85-9c3e-407e-892d-8d3e70b89932, volume: 2657114d-cf3c-45a7-a5da-b4562bf2fb5d, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5410353-975a-42ac-9023-c40150b789e0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:59 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:08:59 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:08:59 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa37a65-0f6e-47e1-b022-bde183f2fd0a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:08:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:08:59 devstack sudo[102741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:08:59 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:00 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:09:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:09:00 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:09:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:00 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d Sep 07 17:09:00 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6bb852d2-ab22-473e-99f3-157819fe2cdf req-02fe30e5-d412-48f0-b433-b92485da2ab2 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:06 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" returned: 0 in 5.923s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:09:06 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Converted 1024.00 MB image at 172.87 MB/s Sep 07 17:09:06 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d is being set with open permissions: ugo+rw Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:06 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d Sep 07 17:09:06 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:06 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" released by "_copy_volume_from_snapshot" :: held 7.149s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" released by "_create_volume_from_snapshot" :: held 7.234s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.251s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6bb852d2-ab22-473e-99f3-157819fe2cdf req-02fe30e5-d412-48f0-b433-b92485da2ab2 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.148s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-6bb852d2-ab22-473e-99f3-157819fe2cdf req-02fe30e5-d412-48f0-b433-b92485da2ab2 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (237bf45a-a6e8-4377-bd5f-b620cb0866c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d', 'volume_size': 2, 'snapshot_id': 'b7e0be85-9c3e-407e-892d-8d3e70b89932'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f184e575-7b67-4d06-a830-a026f079b3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d (2657114d-cf3c-45a7-a5da-b4562bf2fb5d): created successfully Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f184e575-7b67-4d06-a830-a026f079b3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (a9db7a5c-9119-4ef0-bc7d-12400138189a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-6bb852d2-ab22-473e-99f3-157819fe2cdf req-02fe30e5-d412-48f0-b433-b92485da2ab2 tempest-TestInstancesWithCinderVolumes-1276987584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-83551491-ad1b-445a-9321-918abb28ead9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf6b223d-0f4f-4689-b77b-0de18a773d3d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:09:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-00b6c464-2c83-4a43-bc86-faf7376018c4 tempest-VolumesSnapshotTestJSON-1869697952 None] Created volume successfully. Sep 07 17:09:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-6bb852d2-ab22-473e-99f3-157819fe2cdf req-02fe30e5-d412-48f0-b433-b92485da2ab2 tempest-TestInstancesWithCinderVolumes-1276987584 None] attachment_update completed successfully. Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-2657114d-cf3c-45a7-a5da-b4562bf2fb5d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-2657114d-cf3c-45a7-a5da-b4562bf2fb5d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[54180ef6-40ff-449e-84aa-02075b383e44]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:07 devstack sudo[102775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d Sep 07 17:09:07 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:07 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:07 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d Sep 07 17:09:07 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:08 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-2657114d-cf3c-45a7-a5da-b4562bf2fb5d" released by "delete_volume" :: held 0.819s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['281717f1-45cc-4bf4-b94f-0465a8d5fda1', 'ce2fce89-6329-436f-bdb9-2bb4405dc778', '2205b60d-86a2-4cfd-8d01-8b7aa3e8e0ec', '7e69195d-2ccd-450e-bd92-9c69aa957f64'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:08 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:08 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-b7e0be85-9c3e-407e-892d-8d3e70b89932-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-b7e0be85-9c3e-407e-892d-8d3e70b89932-delete_snapshot" acquired by "delete_snapshot" :: waited 0.073s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Deleting offline snapshot b7e0be85-9c3e-407e-892d-8d3e70b89932 of volume 3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:09:08 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] snapshot_file for this snap is: volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.630s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:08 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Deleted volume successfully. Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6064c339-1175-4234-9771-6c1c9a3b65af]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-244fc469-96e7-4fb6-9063-cf91ab94fbfe tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-2657114d-cf3c-45a7-a5da-b4562bf2fb5d-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:09 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:09:09 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:09 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.836s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:09:09 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:09 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[872bcbd2-e08f-4ad9-901e-565babb3c03e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:10 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:09:10 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:10 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:09:10 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.757s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:10 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:09:10 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:11 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:11 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932 Sep 07 17:09:11 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:11 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5.b7e0be85-9c3e-407e-892d-8d3e70b89932" returned: 0 in 0.327s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-b7e0be85-9c3e-407e-892d-8d3e70b89932" released by "_delete_snapshot" :: held 2.708s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" released by "delete_snapshot" :: held 2.760s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['249a86f2-3e53-4dbc-b668-b4090608600d', 'eecbbb20-fca4-4f7e-bb6e-f1892a847505', '94b86299-2e32-4ad5-9ce4-106cbef03ba6', 'b82c6274-2a43-4821-9ac4-fb75c55e06ec'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Delete snapshot completed successfully. Sep 07 17:09:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5ae58a98-ba37-445b-80f3-2ef261979c78 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-b7e0be85-9c3e-407e-892d-8d3e70b89932-delete_snapshot" released by "delete_snapshot" :: held 2.936s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-3a6446cf-5c7b-4930-8ae3-2347af7f3de5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-3a6446cf-5c7b-4930-8ae3-2347af7f3de5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[443a7753-450e-485c-ae58-5cc0282a52fc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:12 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:09:12 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:12 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:13 devstack sudo[102912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5 Sep 07 17:09:13 devstack sudo[102912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:13 devstack sudo[102912]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-3a6446cf-5c7b-4930-8ae3-2347af7f3de5" released by "delete_volume" :: held 0.828s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['2fc842fe-4e3e-4160-8638-247f3eec2045', '464ca509-7e61-4e7e-9616-b3b31c32c1e1', 'b5acbfeb-ab75-4104-a36f-c78bbb11f42d', '5702e612-9f82-44a8-837f-2b89c1e3339f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:13 devstack sudo[102915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:13 devstack sudo[102915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:13 devstack sudo[102915]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Deleted volume successfully. Sep 07 17:09:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-999d722d-5aa9-4c10-b67f-3b53dc623209 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-3a6446cf-5c7b-4930-8ae3-2347af7f3de5-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (cee9d116-4f3f-4f7f-bd1f-5ecaa96eb4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668b9454-b5df-4c4e-aaaa-dc7db337c54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668b9454-b5df-4c4e-aaaa-dc7db337c54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1979038230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bbd81c-f802-41a0-9c7f-d5bcc3de9034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:09:14Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5426ae4-1d2f-4c85-8c99-cda80668f6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5426ae4-1d2f-4c85-8c99-cda80668f6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad447e22-509e-425e-aa79-36d22002bbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad447e22-509e-425e-aa79-36d22002bbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04bbd81c-f802-41a0-9c7f-d5bcc3de9034', 'volume_name': 'volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114820a0-6976-4078-a13d-bf2387ac49be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (114820a0-6976-4078-a13d-bf2387ac49be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a89a4a-3be9-4c87-8bf7-a9562f9fdbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume 04bbd81c-f802-41a0-9c7f-d5bcc3de9034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034', 'volume_size': 1} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1979038230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04bbd81c-f802-41a0-9c7f-d5bcc3de9034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:09:14Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating volume 04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:09:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:09:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:14 devstack sudo[102919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 1073741824 Sep 07 17:09:14 devstack sudo[102919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:14 devstack sudo[102919]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 1073741824" returned: 0 in 0.576s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:15 devstack sudo[102927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:15 devstack sudo[102927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:15 devstack sudo[102927]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.488s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a89a4a-3be9-4c87-8bf7-a9562f9fdbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a3df53-4497-4909-9a7c-a3948fe9bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 (04bbd81c-f802-41a0-9c7f-d5bcc3de9034): created successfully Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a3df53-4497-4909-9a7c-a3948fe9bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (cee9d116-4f3f-4f7f-bd1f-5ecaa96eb4da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-41d5b421-f492-4cb0-a461-0f9b1f269c46 tempest-VolumesSnapshotTestJSON-1869697952 None] Created volume successfully. Sep 07 17:09:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating offline snapshot 0e649891-9268-4e90-8a9a-ffe372e3ea9a of volume 04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:09:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc0ca7f-d48c-4b2b-9e09-0434e22d5cc4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:16 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:16 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:17 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:17 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a 1G Sep 07 17:09:17 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:17 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a 1G" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:17 devstack sudo[102941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:17 devstack sudo[102941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:17 devstack sudo[102941]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.346s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:17 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a is being set with open permissions: ugo+rw Sep 07 17:09:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:17 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:17 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:18 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:18 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info Sep 07 17:09:18 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:18 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info" returned: 0 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:18 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info is being set with open permissions: ugo+rw Sep 07 17:09:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:18 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info Sep 07 17:09:18 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:19 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.info" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a8cb56a-9ad2-4a7f-ad54-b1403ac16b80 tempest-VolumesSnapshotTestJSON-1869697952 None] Create snapshot completed successfully Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (c4d97204-0435-4814-a42e-ff6a56cc515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e5b4be-280b-42e4-a9de-f1ef9cd98e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01e5b4be-280b-42e4-a9de-f1ef9cd98e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1296191469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b420052-33bc-4fb7-8f85-e90ecc14fd90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50a92aeb442546659efd03e1dfdd4be9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e649891-9268-4e90-8a9a-ffe372e3ea9a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:09:20Z,use_quota=True,user_id='e2cb0a8c5b0e487d8f81d45ef4cb0ed3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f12acb7-8fa4-4695-910f-a3ee3a4834ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f12acb7-8fa4-4695-910f-a3ee3a4834ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42783792-71d6-4fd9-8719-9e585d23468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42783792-71d6-4fd9-8719-9e585d23468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5b420052-33bc-4fb7-8f85-e90ecc14fd90', 'volume_name': 'volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90', 'volume_size': 1, 'snapshot_id': '0e649891-9268-4e90-8a9a-ffe372e3ea9a'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2980b8-23b3-43e6-b14e-cb5fac7ad6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2980b8-23b3-43e6-b14e-cb5fac7ad6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a304b86-e43b-47e6-a5c4-6bd63ad60691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:20 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume 5b420052-33bc-4fb7-8f85-e90ecc14fd90: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90', 'volume_size': 1, 'snapshot_id': '0e649891-9268-4e90-8a9a-ffe372e3ea9a'} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a-5b420052-33bc-4fb7-8f85-e90ecc14fd90" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a-5b420052-33bc-4fb7-8f85-e90ecc14fd90" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating volume 5b420052-33bc-4fb7-8f85-e90ecc14fd90 from snapshot 0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] snapshot: 0e649891-9268-4e90-8a9a-ffe372e3ea9a, volume: 5b420052-33bc-4fb7-8f85-e90ecc14fd90, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d761a4-1c13-4b09-8463-21e40719f9e4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:20 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:20 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:21 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2312be-10f4-4c2a-b511-65263afc1638]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:21 devstack sudo[102964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:21 devstack sudo[102964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:21 devstack sudo[102964]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:09:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:21 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 Sep 07 17:09:21 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:26 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90" returned: 0 in 5.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:26 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034, size 1024.00 MB, duration 5.31 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:09:26 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Converted 1024.00 MB image at 192.75 MB/s Sep 07 17:09:26 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 is being set with open permissions: ugo+rw Sep 07 17:09:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:26 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 Sep 07 17:09:26 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:27 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" released by "_copy_volume_from_snapshot" :: held 6.432s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a-5b420052-33bc-4fb7-8f85-e90ecc14fd90" released by "_create_volume_from_snapshot" :: held 6.496s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.515s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a304b86-e43b-47e6-a5c4-6bd63ad60691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90', 'volume_size': 1, 'snapshot_id': '0e649891-9268-4e90-8a9a-ffe372e3ea9a'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb82bd0c-78e3-4d55-ad46-9cd8e50d81b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Volume volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 (5b420052-33bc-4fb7-8f85-e90ecc14fd90): created successfully Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb82bd0c-78e3-4d55-ad46-9cd8e50d81b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Flow 'volume_create_manager' (c4d97204-0435-4814-a42e-ff6a56cc515f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f0046e54-67ed-48fd-ab60-8da4cf8f43d8 tempest-VolumesSnapshotTestJSON-1869697952 None] Created volume successfully. Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-5b420052-33bc-4fb7-8f85-e90ecc14fd90-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-5b420052-33bc-4fb7-8f85-e90ecc14fd90-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ebbc0a-49c9-488f-b389-df50beb84aba]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:28 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 Sep 07 17:09:28 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:28 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:28 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90 Sep 07 17:09:28 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:29 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-5b420052-33bc-4fb7-8f85-e90ecc14fd90" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-5b420052-33bc-4fb7-8f85-e90ecc14fd90" released by "delete_volume" :: held 0.630s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['470f9c23-5e7b-40c7-88c5-121f4975d28d', '26483b42-5925-41f4-9ec7-641fe146d924', '0f2cf84b-6810-4c85-9d03-5c0ffe8c472b', 'f571babd-f334-493b-8da3-08d77602a48f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:29 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:29 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:29 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Deleted volume successfully. Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ab001bf7-7f83-4dc9-8d5d-d9ccedbc8de9 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-5b420052-33bc-4fb7-8f85-e90ecc14fd90-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-0e649891-9268-4e90-8a9a-ffe372e3ea9a-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-0e649891-9268-4e90-8a9a-ffe372e3ea9a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Deleting offline snapshot 0e649891-9268-4e90-8a9a-ffe372e3ea9a of volume 04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] snapshot_file for this snap is: volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77947b-4104-4469-b9f1-38cb459e1e94]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:29 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:29 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:29 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dce45b-b5e0-4976-99e8-ab40af7808e3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:30 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:30 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:30 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:30 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:30 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:30 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:30 devstack sudo[103023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a Sep 07 17:09:30 devstack sudo[103023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:31 devstack sudo[103023]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034.0e649891-9268-4e90-8a9a-ffe372e3ea9a" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-0e649891-9268-4e90-8a9a-ffe372e3ea9a" released by "_delete_snapshot" :: held 1.529s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" released by "delete_snapshot" :: held 1.553s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['14c81f7b-1baf-415d-b524-b6fd49fc61f0', '2a337aab-b15a-47d3-8912-af4c29176302', 'ad1b31b9-1ae1-4977-8776-98b9b7c2161d', '209cc2d8-08f3-404f-ba24-d2eb67eb7f1c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Delete snapshot completed successfully. Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-15a7fdf0-7b73-470c-8dc7-5a1108ad7c9f tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-0e649891-9268-4e90-8a9a-ffe372e3ea9a-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-04bbd81c-f802-41a0-9c7f-d5bcc3de9034-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-04bbd81c-f802-41a0-9c7f-d5bcc3de9034-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc808e52-758a-435f-9635-15c635eabd18]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:31 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:31 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:32 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:32 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034 Sep 07 17:09:32 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:32 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-04bbd81c-f802-41a0-9c7f-d5bcc3de9034" released by "delete_volume" :: held 0.672s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['3e4f3cdd-de96-4973-9f33-6d2e6a0bee2d', '705c1815-0c98-49aa-9ed9-fe008421ca0b', 'c43e2405-46e7-47b8-9d65-1fec06bfac6b', '19f45de5-0b08-4066-8026-f48f79a36d60'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:32 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:32 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:32 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Deleted volume successfully. Sep 07 17:09:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-840eeef4-75d7-4847-b02c-9656e5c16759 tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-04bbd81c-f802-41a0-9c7f-d5bcc3de9034-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ce1bee-edd7-42dd-86e5-7203a5f5e587]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:33 devstack sudo[103044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe Sep 07 17:09:33 devstack sudo[103044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:33 devstack sudo[103044]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:33 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe Sep 07 17:09:33 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:33 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" returned: 0 in 0.380s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-quobyte-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe" released by "delete_volume" :: held 0.904s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Created reservations ['09f0072e-2e16-4c7b-8749-f78c875106e6', '33ff6b89-f602-4952-994b-0e1ab1ad8742', '209754ce-2e86-4033-aa68-36137862acad', '5c86ee00-9632-4292-9f43-1a781fe24bfb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:34 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:34 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:34 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Deleted volume successfully. Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6e167786-c75e-4664-83df-4a0927ae913d tempest-VolumesSnapshotTestJSON-1869697952 None] Lock "cinder-19e6aeab-aa82-4d3b-b3c3-cc398fa370fe-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-a7f66794-8d01-4dd7-a5c0-af1bf9ec5515 tempest-TestShelveInstance-1564437632 None] Terminate volume connection completed successfully. Sep 07 17:09:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-a7f66794-8d01-4dd7-a5c0-af1bf9ec5515 tempest-TestShelveInstance-1564437632 None] Deleting attachment 05d57900-2f01-446e-9517-e5d0c496dcfe. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Acquiring lock "cinder-c538e209-ac00-47ba-a332-493e59f78d93-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "cinder-c538e209-ac00-47ba-a332-493e59f78d93-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Acquiring lock "cinder-quobyte-c538e209-ac00-47ba-a332-493e59f78d93" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "cinder-quobyte-c538e209-ac00-47ba-a332-493e59f78d93" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4f0d715-da6d-40c7-9833-6d23f7f6579d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:35 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 Sep 07 17:09:35 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:35 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93" returned: 0 in 0.462s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:35 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93 Sep 07 17:09:35 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:35 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c538e209-ac00-47ba-a332-493e59f78d93" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "cinder-quobyte-c538e209-ac00-47ba-a332-493e59f78d93" released by "delete_volume" :: held 0.807s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG cinder.quota [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Created reservations ['0ba036b7-2d55-4b50-ad92-a80e1897c8e7', 'd417dfc1-61e8-4040-98cc-cd80c6501283', '7ba2cce3-345a-4b14-a883-dbaf5aa3fc8e', '21df40b2-8909-4f42-9018-2f4b4c312d2c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=104,cinder:INSERT=23,cinder:UPDATE=84,cinder:DELETE=8 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:36 devstack sudo[103088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:36 devstack sudo[103088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:36 devstack sudo[103088]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG cinder.manager [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Deleted volume successfully. Sep 07 17:09:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [req-a552a6d1-bc17-40ee-bdae-d5a1421dff23 req-c50b7168-663d-4f6b-aa68-41732ae130c2 tempest-TestShelveInstance-1564437632 None] Lock "cinder-c538e209-ac00-47ba-a332-493e59f78d93-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:39 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=102,cinder:UPDATE=111,cinder:DELETE=8,cinder:INSERT=33 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:09:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fec3deaf-f89c-4829-ad8f-7011b366040f req-9509943b-2abf-42d5-8597-eefc16b8de05 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fec3deaf-f89c-4829-ad8f-7011b366040f req-9509943b-2abf-42d5-8597-eefc16b8de05 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-fec3deaf-f89c-4829-ad8f-7011b366040f req-9509943b-2abf-42d5-8597-eefc16b8de05 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-fec3deaf-f89c-4829-ad8f-7011b366040f req-9509943b-2abf-42d5-8597-eefc16b8de05 tempest-TestInstancesWithCinderVolumes-1276987584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fdaca94-644d-43de-bbed-aef992460d49', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:09:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-fec3deaf-f89c-4829-ad8f-7011b366040f req-9509943b-2abf-42d5-8597-eefc16b8de05 tempest-TestInstancesWithCinderVolumes-1276987584 None] attachment_update completed successfully. Sep 07 17:09:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-318b2946-84b7-440c-b96e-d26b7e6e5b59 req-648336f6-f620-4d8a-af65-939c447bf3a6 tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-318b2946-84b7-440c-b96e-d26b7e6e5b59 req-648336f6-f620-4d8a-af65-939c447bf3a6 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-318b2946-84b7-440c-b96e-d26b7e6e5b59 req-648336f6-f620-4d8a-af65-939c447bf3a6 tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-318b2946-84b7-440c-b96e-d26b7e6e5b59 req-648336f6-f620-4d8a-af65-939c447bf3a6 tempest-TestInstancesWithCinderVolumes-1276987584 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-bf449437-8c92-48c5-8a7b-37b415ba0811', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '20b49d1c-ca74-444a-9bc9-b21a47793694', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:09:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-318b2946-84b7-440c-b96e-d26b7e6e5b59 req-648336f6-f620-4d8a-af65-939c447bf3a6 tempest-TestInstancesWithCinderVolumes-1276987584 None] attachment_update completed successfully. Sep 07 17:09:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8e41b361-a904-4c9f-908e-36461c3ba45d req-5b976ea7-d697-4313-b2a2-c48b04d68781 tempest-TestInstancesWithCinderVolumes-1276987584 None] Terminate volume connection completed successfully. Sep 07 17:09:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8e41b361-a904-4c9f-908e-36461c3ba45d req-5b976ea7-d697-4313-b2a2-c48b04d68781 tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleting attachment 4fdaca94-644d-43de-bbed-aef992460d49. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:09:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-6f7682dd-eaf7-4da3-9dda-5e00c42d3307-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-6f7682dd-eaf7-4da3-9dda-5e00c42d3307-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-quobyte-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0544d2ea-e4ce-4b30-9ba7-84f2e8f8973f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:48 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 Sep 07 17:09:48 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:48 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" returned: 0 in 0.640s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:48 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307 Sep 07 17:09:48 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:49 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-6f7682dd-eaf7-4da3-9dda-5e00c42d3307" released by "delete_volume" :: held 1.057s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:49 devstack cinder-volume[86783]: WARNING cinder.quota [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1665581348-1151629502 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1665581348-1151629502, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:09:49 devstack cinder-volume[86783]: WARNING cinder.quota [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1665581348-1151629502 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1665581348-1151629502, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Created reservations ['3b1de8bb-5304-4d1d-80f4-b4b89459875b', '21c53e4c-d517-41cc-bb0a-a2da29e9de71', 'b328e620-a6f1-451a-96ed-71027abb4048', '67955527-6567-429c-a994-50cbd9e9f8d8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:49 devstack sudo[103218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:49 devstack sudo[103218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:49 devstack sudo[103218]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleted volume successfully. Sep 07 17:09:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5fd8226c-c701-4ce8-81c2-4d80758a3cbf tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-6f7682dd-eaf7-4da3-9dda-5e00c42d3307-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-8f67c2f6-9bb5-423b-8455-35ca52c3291d req-06ed953f-76f7-4ab0-9a93-9e498557c821 tempest-TestInstancesWithCinderVolumes-1276987584 None] Terminate volume connection completed successfully. Sep 07 17:09:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-8f67c2f6-9bb5-423b-8455-35ca52c3291d req-06ed953f-76f7-4ab0-9a93-9e498557c821 tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleting attachment 20b49d1c-ca74-444a-9bc9-b21a47793694. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-bf449437-8c92-48c5-8a7b-37b415ba0811-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-bf449437-8c92-48c5-8a7b-37b415ba0811-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-quobyte-bf449437-8c92-48c5-8a7b-37b415ba0811" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-bf449437-8c92-48c5-8a7b-37b415ba0811" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[87337df1-50b1-45e8-b8c2-1ea7749f9fc0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:53 devstack sudo[103250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 Sep 07 17:09:53 devstack sudo[103250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:53 devstack sudo[103250]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:53 devstack sudo[103255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811 Sep 07 17:09:53 devstack sudo[103255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:54 devstack sudo[103255]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bf449437-8c92-48c5-8a7b-37b415ba0811" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-bf449437-8c92-48c5-8a7b-37b415ba0811" released by "delete_volume" :: held 0.859s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:54 devstack cinder-volume[86783]: WARNING cinder.quota [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-415470203-24602681 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-415470203-24602681, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:09:54 devstack cinder-volume[86783]: WARNING cinder.quota [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-415470203-24602681 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-415470203-24602681, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Created reservations ['84bf703f-0d3c-4481-8575-492252a52781', 'f5b362ec-b96d-4c08-a5f7-03b46321c220', '34fad54e-db2b-4086-85a4-154b61eba4e3', 'd998d611-ad88-4e14-9bee-93ed655acc33'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:54 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:09:54 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:54 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:09:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleted volume successfully. Sep 07 17:09:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-224edaa1-cd1f-4b31-8935-62fa2c46199f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-bf449437-8c92-48c5-8a7b-37b415ba0811-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Flow 'volume_create_manager' (896934c9-f0e6-48e4-8cfb-29ace2014ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de8ee90-e549-43fb-af26-de14a7cf2c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de8ee90-e549-43fb-af26-de14a7cf2c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fdee72-0a82-489a-afdd-8fafbbf137f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa4dcf98ac1460a85f2915af7ee6ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:09:56Z,use_quota=True,user_id='85d4f6b7706b4ad1b8103c0fa28b5d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(768ad067-7650-421a-8ff3-6df5986eae4e),volume_type_id=768ad067-7650-421a-8ff3-6df5986eae4e)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcd43d7-7da4-486d-b110-8db7f190828e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bcd43d7-7da4-486d-b110-8db7f190828e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dd9b60-44fb-4a65-9e5b-f5a16e985935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:55 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52dd9b60-44fb-4a65-9e5b-f5a16e985935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73fdee72-0a82-489a-afdd-8fafbbf137f5', 'volume_name': 'volume-73fdee72-0a82-489a-afdd-8fafbbf137f5', 'volume_size': 1, 'image_id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d664899ba56a27afe5dbdba6f8e5b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fa4dcf98ac1460a85f2915af7ee6ac2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd085fd96456b893b53b3a3efacdbc72014f06e98a83756dba4a22cf31e0299a2f84abe0436c98a77ba9915b7a820b336ea48a34125e6dde6e5669c40eb36acf8', 'id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'created_at': datetime.datetime(2026, 9, 7, 15, 9, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 9, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d673ec9-6bf2-49cb-836c-c075beb31e61/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b174c41-5ddc-45b1-b40e-d14205d81e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b174c41-5ddc-45b1-b40e-d14205d81e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38520de2-e405-47ef-b238-f5f09c7400b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:09:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Volume 73fdee72-0a82-489a-afdd-8fafbbf137f5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73fdee72-0a82-489a-afdd-8fafbbf137f5', 'volume_size': 1, 'image_id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d664899ba56a27afe5dbdba6f8e5b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fa4dcf98ac1460a85f2915af7ee6ac2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd085fd96456b893b53b3a3efacdbc72014f06e98a83756dba4a22cf31e0299a2f84abe0436c98a77ba9915b7a820b336ea48a34125e6dde6e5669c40eb36acf8', 'id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'created_at': datetime.datetime(2026, 9, 7, 15, 9, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 9, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d673ec9-6bf2-49cb-836c-c075beb31e61/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Trying to clone 73fdee72-0a82-489a-afdd-8fafbbf137f5 from image 8d673ec9-6bf2-49cb-836c-c075beb31e61 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:09:56 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fa3b17-85ba-4dc3-9167-e71a0e34025c]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:56 devstack sudo[103263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:09:56 devstack sudo[103263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:56 devstack sudo[103263]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:56 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:09:56 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:57 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 1 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Temporary image 8d673ec9-6bf2-49cb-836c-c075beb31e61 is fetched for user 85d4f6b7706b4ad1b8103c0fa28b5d4e. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a00e7d-4ac0-4457-b52f-d93e481335b4]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:57 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:09:57 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:57 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:57 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:09:57 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:58 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 1 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:09:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fdee72-0a82-489a-afdd-8fafbbf137f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fa4dcf98ac1460a85f2915af7ee6ac2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:09:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:09:56Z,use_quota=True,user_id='85d4f6b7706b4ad1b8103c0fa28b5d4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(768ad067-7650-421a-8ff3-6df5986eae4e),volume_type_id=768ad067-7650-421a-8ff3-6df5986eae4e)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Creating volume 73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:09:58 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:58 devstack sudo[103288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1073741824 Sep 07 17:09:58 devstack sudo[103288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:58 devstack sudo[103288]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1073741824" returned: 0 in 0.672s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:58 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 Sep 07 17:09:58 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:59 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Attempting download of 8d673ec9-6bf2-49cb-836c-c075beb31e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}])) to volume 73fdee72-0a82-489a-afdd-8fafbbf137f5. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[02053d71-21cf-4d1a-aabf-d4cb93cb586b]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:59 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx Sep 07 17:09:59 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:09:59 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:09:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:09:59 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx Sep 07 17:09:59 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-ef0d8e84-126e-45c8-8a38-0aff95cf065d req-a5456f51-0749-4411-9d57-2d5954c8b32a tempest-TestInstancesWithCinderVolumes-1276987584 None] Terminate volume connection completed successfully. Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-ef0d8e84-126e-45c8-8a38-0aff95cf065d req-a5456f51-0749-4411-9d57-2d5954c8b32a tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleting attachment cf6b223d-0f4f-4689-b77b-0de18a773d3d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:10:00 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx" returned: 1 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d673ec9-6bf2-49cb-836c-c075beb31e61_6g1q9rhx' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee46cc-8f7e-4526-b624-2867b9f704dc]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:00 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:10:00 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:00 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:00 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD Sep 07 17:10:00 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:00 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD" returned: 1 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] 8d673ec9-6bf2-49cb-836c-c075beb31e61 was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:10:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:00 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 Sep 07 17:10:00 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-83551491-ad1b-445a-9321-918abb28ead9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-83551491-ad1b-445a-9321-918abb28ead9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "cinder-quobyte-83551491-ad1b-445a-9321-918abb28ead9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-83551491-ad1b-445a-9321-918abb28ead9" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[122cc105-2ee3-449a-b4ee-f603dc2f244d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:01 devstack sudo[103337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 Sep 07 17:10:01 devstack sudo[103337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:01 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5" returned: 0 in 0.563s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d673ec9-6bf2-49cb-836c-c075beb31e61_ctqkf88idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:10:01 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:01 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1G Sep 07 17:10:01 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:01 devstack sudo[103337]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:01 devstack sudo[103348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9 Sep 07 17:10:01 devstack sudo[103348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:01 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 1G" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Downloaded image 8d673ec9-6bf2-49cb-836c-c075beb31e61 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}])) to volume 73fdee72-0a82-489a-afdd-8fafbbf137f5 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Temporary image 8d673ec9-6bf2-49cb-836c-c075beb31e61 for user 85d4f6b7706b4ad1b8103c0fa28b5d4e is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Marking volume 73fdee72-0a82-489a-afdd-8fafbbf137f5 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Copying metadata from image 8d673ec9-6bf2-49cb-836c-c075beb31e61 to 73fdee72-0a82-489a-afdd-8fafbbf137f5. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Creating volume glance metadata for volume 73fdee72-0a82-489a-afdd-8fafbbf137f5 backed by image 8d673ec9-6bf2-49cb-836c-c075beb31e61 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '26d664899ba56a27afe5dbdba6f8e5b9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38520de2-e405-47ef-b238-f5f09c7400b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fdee72-0a82-489a-afdd-8fafbbf137f5', 'volume_size': 1, 'image_id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d673ec9-6bf2-49cb-836c-c075beb31e61', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '26d664899ba56a27afe5dbdba6f8e5b9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2fa4dcf98ac1460a85f2915af7ee6ac2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd085fd96456b893b53b3a3efacdbc72014f06e98a83756dba4a22cf31e0299a2f84abe0436c98a77ba9915b7a820b336ea48a34125e6dde6e5669c40eb36acf8', 'id': '8d673ec9-6bf2-49cb-836c-c075beb31e61', 'created_at': datetime.datetime(2026, 9, 7, 15, 9, 53, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 9, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d673ec9-6bf2-49cb-836c-c075beb31e61/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56329982-4b0a-47fe-b0fd-e6f5d4689b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Volume volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 (73fdee72-0a82-489a-afdd-8fafbbf137f5): created successfully Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56329982-4b0a-47fe-b0fd-e6f5d4689b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Flow 'volume_create_manager' (896934c9-f0e6-48e4-8cfb-29ace2014ed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e7a14f7b-3eaf-4ecc-ada5-260613751fbb tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Created volume successfully. Sep 07 17:10:02 devstack sudo[103348]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-83551491-ad1b-445a-9321-918abb28ead9" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-quobyte-83551491-ad1b-445a-9321-918abb28ead9" released by "delete_volume" :: held 0.823s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571254964-712868840 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571254964-712868840, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:10:02 devstack cinder-volume[86783]: WARNING cinder.quota [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571254964-712868840 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-571254964-712868840, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Acquiring lock "cinder-73fdee72-0a82-489a-afdd-8fafbbf137f5-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Created reservations ['57bcbccf-82b6-46a3-8405-504e479ff87d', '1b93335a-1020-4f4b-8770-fb06dcb5eaca', 'cbc2de88-f81b-4509-860b-ad8a56950a09', 'c0413128-fb7c-49ac-8718-dc066aaa840a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "cinder-73fdee72-0a82-489a-afdd-8fafbbf137f5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Acquiring lock "cinder-quobyte-73fdee72-0a82-489a-afdd-8fafbbf137f5" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "cinder-quobyte-73fdee72-0a82-489a-afdd-8fafbbf137f5" acquired by "delete_volume" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:02 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:10:02 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0f8d8a-3e0a-4e9c-8463-8754a1e0a718]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:02 devstack sudo[103354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 Sep 07 17:10:02 devstack sudo[103354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:02 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:10:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Deleted volume successfully. Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-73a1ef39-977a-42ce-a2f1-3f71827e9e9f tempest-TestInstancesWithCinderVolumes-1276987584 None] Lock "cinder-83551491-ad1b-445a-9321-918abb28ead9-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:02 devstack sudo[103354]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:02 devstack sudo[103360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5 Sep 07 17:10:02 devstack sudo[103360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:03 devstack sudo[103360]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-73fdee72-0a82-489a-afdd-8fafbbf137f5" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "cinder-quobyte-73fdee72-0a82-489a-afdd-8fafbbf137f5" released by "delete_volume" :: held 0.817s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:03 devstack cinder-volume[86783]: WARNING cinder.quota [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:10:03 devstack cinder-volume[86783]: WARNING cinder.quota [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Created reservations ['21fe0a26-df54-43fe-a46f-3572494075e8', '2dc6d7cd-b921-4703-a099-fe69f8e728f2', '072f1cc6-fa89-4ae1-b96f-56270fbdea7f', '71caa7f8-9db0-4f79-9903-8a82d15a20d1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:03 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:10:03 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:03 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:10:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Deleted volume successfully. Sep 07 17:10:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cd73891d-ffa9-4154-bc62-c1bacf0bf3bc tempest-VolumeAndVolumeTypeFromImageTest-655606382 None] Lock "cinder-73fdee72-0a82-489a-afdd-8fafbbf137f5-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:09 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:10:09 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:10 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.341s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:10:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:10:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:10:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Flow 'volume_create_manager' (5b0498b4-60ad-47b4-9a5e-b8010be6f0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773b5a72-904e-49f4-a772-e39d4cf599b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773b5a72-904e-49f4-a772-e39d4cf599b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a0583e-189a-45ba-afc4-94c1e75e56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aaacad1956478a9edb02dd260af8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:11Z,use_quota=True,user_id='b0e118d92c704954ac7700d4e287c401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfca741-7b0e-4d43-aa45-48296cf7c57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dfca741-7b0e-4d43-aa45-48296cf7c57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e78e80-ed07-4a60-a596-3316456122e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9e78e80-ed07-4a60-a596-3316456122e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1a0583e-189a-45ba-afc4-94c1e75e56ff', 'volume_name': 'volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d314f55d-8bcd-4372-9999-c35e77d9c3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d314f55d-8bcd-4372-9999-c35e77d9c3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419db759-fe2a-4499-97fa-766114373401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Volume b1a0583e-189a-45ba-afc4-94c1e75e56ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff', 'volume_size': 1} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1a0583e-189a-45ba-afc4-94c1e75e56ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aaacad1956478a9edb02dd260af8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:11Z,use_quota=True,user_id='b0e118d92c704954ac7700d4e287c401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Creating volume b1a0583e-189a-45ba-afc4-94c1e75e56ff {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:10:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:11 devstack sudo[103378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff 1073741824 Sep 07 17:10:11 devstack sudo[103378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:11 devstack sudo[103378]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff 1073741824" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:11 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff Sep 07 17:10:11 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:12 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (419db759-fe2a-4499-97fa-766114373401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117d0037-0348-4eee-b33c-a57f84cf4921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Volume volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff (b1a0583e-189a-45ba-afc4-94c1e75e56ff): created successfully Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117d0037-0348-4eee-b33c-a57f84cf4921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Flow 'volume_create_manager' (5b0498b4-60ad-47b4-9a5e-b8010be6f0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-72689a8a-c148-4253-aa8a-2bcc0f105bff tempest-CinderUnicodeTest-1889094992 None] Created volume successfully. Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Flow 'volume_create_manager' (427a52ae-745a-4326-8364-e6155dd5788e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4e294c-c7e3-4b8c-b590-416d518e69f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c4e294c-c7e3-4b8c-b590-416d518e69f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1837096629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4a2daf-40da-4bed-875e-3a877cad864e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aaacad1956478a9edb02dd260af8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:14Z,use_quota=True,user_id='b0e118d92c704954ac7700d4e287c401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4620d2-c511-4b0f-a02c-2f92391d241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca4620d2-c511-4b0f-a02c-2f92391d241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c364802d-d6a1-407b-b5db-c8a2c531b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c364802d-d6a1-407b-b5db-c8a2c531b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4a2daf-40da-4bed-875e-3a877cad864e', 'volume_name': 'volume-9e4a2daf-40da-4bed-875e-3a877cad864e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57649e5-b9c2-463f-b713-3bf7581bf550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a57649e5-b9c2-463f-b713-3bf7581bf550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f7d23-797e-4318-9b5e-441868a1e1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Volume 9e4a2daf-40da-4bed-875e-3a877cad864e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4a2daf-40da-4bed-875e-3a877cad864e', 'volume_size': 1} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1837096629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4a2daf-40da-4bed-875e-3a877cad864e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82aaacad1956478a9edb02dd260af8fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:14Z,use_quota=True,user_id='b0e118d92c704954ac7700d4e287c401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Creating volume 9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:10:14 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:14 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e 1073741824 Sep 07 17:10:14 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:14 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e 1073741824" returned: 0 in 0.636s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:14 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e Sep 07 17:10:14 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:15 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e" returned: 0 in 0.352s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (953f7d23-797e-4318-9b5e-441868a1e1fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4a2daf-40da-4bed-875e-3a877cad864e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ce9517-7969-455b-a468-61338416de3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Volume volume-9e4a2daf-40da-4bed-875e-3a877cad864e (9e4a2daf-40da-4bed-875e-3a877cad864e): created successfully Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78ce9517-7969-455b-a468-61338416de3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Flow 'volume_create_manager' (427a52ae-745a-4326-8364-e6155dd5788e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-27c44525-d805-42ce-89d5-c1acd2ef7346 tempest-CinderUnicodeTest-1889094992 None] Created volume successfully. Sep 07 17:10:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Creating offline snapshot d3e90219-80f2-4fc4-af12-04d74aea78a1 of volume 9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:10:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[923080f7-3539-4f96-9f45-205f79529888]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:16 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e Sep 07 17:10:16 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:17 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e" returned: 0 in 0.575s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:17 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 1G Sep 07 17:10:17 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:18 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 1G" returned: 0 in 1.052s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4a2daf-40da-4bed-875e-3a877cad864e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:18 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4a2daf-40da-4bed-875e-3a877cad864e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 Sep 07 17:10:18 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:18 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e4a2daf-40da-4bed-875e-3a877cad864e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:18 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 is being set with open permissions: ugo+rw Sep 07 17:10:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:18 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 Sep 07 17:10:18 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:18 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:19 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info Sep 07 17:10:19 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:19 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:19 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info is being set with open permissions: ugo+rw Sep 07 17:10:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:19 devstack sudo[103525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info Sep 07 17:10:19 devstack sudo[103525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:19 devstack sudo[103525]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.info" returned: 0 in 0.348s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f4dd5a7d-1aa1-4bfe-a3d8-b4582d0747da tempest-CinderUnicodeTest-1889094992 None] Create snapshot completed successfully Sep 07 17:10:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-d3e90219-80f2-4fc4-af12-04d74aea78a1-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-d3e90219-80f2-4fc4-af12-04d74aea78a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" acquired by "delete_snapshot" :: waited 0.051s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-quobyte-d3e90219-80f2-4fc4-af12-04d74aea78a1" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-d3e90219-80f2-4fc4-af12-04d74aea78a1" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Deleting offline snapshot d3e90219-80f2-4fc4-af12-04d74aea78a1 of volume 9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] snapshot_file for this snap is: volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8887e545-9e9b-4541-bbc7-b6c103de365c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:21 devstack sudo[103537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 Sep 07 17:10:21 devstack sudo[103537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Flow 'volume_create_manager' (774a3a1f-dcbd-45ac-827b-046577445f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04438d70-fed3-475d-bd4e-8dc4f192a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04438d70-fed3-475d-bd4e-8dc4f192a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-480562771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf85844-804d-4304-b33a-3ab64efee6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962224fabdf4488e859b1de2a23009af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:21Z,use_quota=True,user_id='04bf2a65697f4e5c9e88e64a1a2425fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337f5c9-749e-48e7-8f0d-87f1c6f63269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337f5c9-749e-48e7-8f0d-87f1c6f63269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6255b8f5-f0f4-4cff-bd95-090293d46b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6255b8f5-f0f4-4cff-bd95-090293d46b9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cf85844-804d-4304-b33a-3ab64efee6f6', 'volume_name': 'volume-9cf85844-804d-4304-b33a-3ab64efee6f6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c3593f-7d9d-43ab-b875-8ebb3b63e2e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c3593f-7d9d-43ab-b875-8ebb3b63e2e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147fb095-b26a-43ee-b1a1-563cf91f1ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Volume 9cf85844-804d-4304-b33a-3ab64efee6f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cf85844-804d-4304-b33a-3ab64efee6f6', 'volume_size': 1} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-480562771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cf85844-804d-4304-b33a-3ab64efee6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='962224fabdf4488e859b1de2a23009af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:10:21Z,use_quota=True,user_id='04bf2a65697f4e5c9e88e64a1a2425fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Creating volume 9cf85844-804d-4304-b33a-3ab64efee6f6 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:10:21 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:21 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 1073741824 Sep 07 17:10:21 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:21 devstack sudo[103537]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1" returned: 0 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e4a2daf-40da-4bed-875e-3a877cad864e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bfc796-5dc7-46e1-8408-96cb8fc48f7c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:21 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e Sep 07 17:10:21 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:22 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 1073741824" returned: 0 in 0.562s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:22 devstack sudo[103550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 Sep 07 17:10:22 devstack sudo[103550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:22 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e" returned: 0 in 0.519s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:22 devstack sudo[103555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 Sep 07 17:10:22 devstack sudo[103555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:22 devstack sudo[103550]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (147fb095-b26a-43ee-b1a1-563cf91f1ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cf85844-804d-4304-b33a-3ab64efee6f6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca65e456-90c0-4173-b1d2-0b64724146dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:10:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Volume volume-9cf85844-804d-4304-b33a-3ab64efee6f6 (9cf85844-804d-4304-b33a-3ab64efee6f6): created successfully Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca65e456-90c0-4173-b1d2-0b64724146dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Flow 'volume_create_manager' (774a3a1f-dcbd-45ac-827b-046577445f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:10:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2c093e92-ae88-408b-a06d-9844c02e5502 tempest-TestMinimumBasicScenario-1524897602 None] Created volume successfully. Sep 07 17:10:22 devstack sudo[103555]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1" returned: 0 in 0.464s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:22 devstack sudo[103561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1 Sep 07 17:10:22 devstack sudo[103561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:22 devstack sudo[103561]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e.d3e90219-80f2-4fc4-af12-04d74aea78a1" returned: 0 in 0.274s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-d3e90219-80f2-4fc4-af12-04d74aea78a1" released by "_delete_snapshot" :: held 1.956s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" released by "delete_snapshot" :: held 1.999s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Created reservations ['46830613-b03d-48ff-84dc-ee9967783a7d', 'b4001303-605b-48dd-b09b-afec58358b81', '27ecc9b4-f39f-4b29-8948-dcb5ad509c79', '57cebe7d-4147-4b9c-9671-fd4da6384b95'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:10:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Delete snapshot completed successfully. Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9061e5b6-c609-4f58-9b1a-ff6cd79ac6ef tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-d3e90219-80f2-4fc4-af12-04d74aea78a1-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-9e4a2daf-40da-4bed-875e-3a877cad864e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-9e4a2daf-40da-4bed-875e-3a877cad864e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[22187a32-1989-4799-919e-1137c38898e8]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:23 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e Sep 07 17:10:23 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:24 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e" returned: 0 in 0.598s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:24 devstack sudo[103572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e Sep 07 17:10:24 devstack sudo[103572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-9c97a7fc-b3a3-42dc-8b99-dfce4c6419e8 req-d85fbb40-264c-43ff-9c2a-a49b7c7b49b2 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-9c97a7fc-b3a3-42dc-8b99-dfce4c6419e8 req-d85fbb40-264c-43ff-9c2a-a49b7c7b49b2 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:24 devstack sudo[103572]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9e4a2daf-40da-4bed-875e-3a877cad864e" returned: 0 in 0.509s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-9c97a7fc-b3a3-42dc-8b99-dfce4c6419e8 req-d85fbb40-264c-43ff-9c2a-a49b7c7b49b2 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-9e4a2daf-40da-4bed-875e-3a877cad864e" released by "delete_volume" :: held 1.181s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-9c97a7fc-b3a3-42dc-8b99-dfce4c6419e8 req-d85fbb40-264c-43ff-9c2a-a49b7c7b49b2 tempest-TestMinimumBasicScenario-1524897602 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-9cf85844-804d-4304-b33a-3ab64efee6f6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2181ccaa-e85b-4ca5-bdb2-0056039e0f3d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Created reservations ['1a3b27a7-199e-4364-a4a6-fc6490e7aec1', 'f3eb17da-259a-4c75-8441-403fe509d662', '2355f2d6-9caa-490e-83fc-45e006bf1584', '72e7e741-aa8e-4255-a5c8-3e60b7b477e4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:10:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-9c97a7fc-b3a3-42dc-8b99-dfce4c6419e8 req-d85fbb40-264c-43ff-9c2a-a49b7c7b49b2 tempest-TestMinimumBasicScenario-1524897602 None] attachment_update completed successfully. Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:24 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:10:24 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:25 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:10:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Deleted volume successfully. Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d60eb84e-1859-4448-9437-34d2bc393436 tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-9e4a2daf-40da-4bed-875e-3a877cad864e-delete_volume" released by "delete_volume" :: held 1.852s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-b1a0583e-189a-45ba-afc4-94c1e75e56ff-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-b1a0583e-189a-45ba-afc4-94c1e75e56ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "cinder-quobyte-b1a0583e-189a-45ba-afc4-94c1e75e56ff" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-b1a0583e-189a-45ba-afc4-94c1e75e56ff" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[de597921-5e69-4767-a168-464e9a90c460]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:10:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:26 devstack sudo[103970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff Sep 07 17:10:26 devstack sudo[103970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:26 devstack sudo[103970]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff" returned: 0 in 0.597s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:26 devstack sudo[103975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff Sep 07 17:10:26 devstack sudo[103975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:26 devstack sudo[103975]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1a0583e-189a-45ba-afc4-94c1e75e56ff" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-quobyte-b1a0583e-189a-45ba-afc4-94c1e75e56ff" released by "delete_volume" :: held 1.053s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Created reservations ['6f5bbfad-11f8-4cd9-81fe-235590f1ce31', '474951a6-52cb-4ea4-b6b9-4d5a27e7ecf9', '479e7393-a5b8-468c-b9bd-5ee57fe76286', '22d52e98-e4e6-4e9b-8470-80a509d5f168'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:10:27 devstack sudo[103978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:10:27 devstack sudo[103978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:10:27 devstack sudo[103978]: pam_unix(sudo:session): session closed for user root Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:10:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Deleted volume successfully. Sep 07 17:10:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-aba49264-ddab-47ea-a6fa-1997cd95128c tempest-CinderUnicodeTest-1889094992 None] Lock "cinder-b1a0583e-189a-45ba-afc4-94c1e75e56ff-delete_volume" released by "delete_volume" :: held 1.841s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:10:37 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=76,cinder:DELETE=6,cinder:SELECT=83,cinder:INSERT=18 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:10:37 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=68,cinder:UPDATE=72,cinder:INSERT=25,cinder:DELETE=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:09 devstack sudo[104245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:09 devstack sudo[104245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:10 devstack sudo[104245]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:11:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:11:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:11:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-97f57c10-9fb9-4c32-b196-0c1f788d1d3a req-03a4bd00-16ce-4d28-8ebb-67490fd5d2b3 tempest-TestMinimumBasicScenario-1524897602 None] Terminate volume connection completed successfully. Sep 07 17:11:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-97f57c10-9fb9-4c32-b196-0c1f788d1d3a req-03a4bd00-16ce-4d28-8ebb-67490fd5d2b3 tempest-TestMinimumBasicScenario-1524897602 None] Deleting attachment 2181ccaa-e85b-4ca5-bdb2-0056039e0f3d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "cinder-9cf85844-804d-4304-b33a-3ab64efee6f6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "cinder-9cf85844-804d-4304-b33a-3ab64efee6f6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "cinder-quobyte-9cf85844-804d-4304-b33a-3ab64efee6f6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "cinder-quobyte-9cf85844-804d-4304-b33a-3ab64efee6f6" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c342bd8-d95e-408e-8209-e566c0e13254]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:12 devstack sudo[104254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 Sep 07 17:11:12 devstack sudo[104254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:13 devstack sudo[104254]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:13 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6 Sep 07 17:11:13 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:13 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-9cf85844-804d-4304-b33a-3ab64efee6f6" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "cinder-quobyte-9cf85844-804d-4304-b33a-3ab64efee6f6" released by "delete_volume" :: held 0.668s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Created reservations ['b4576272-3b26-4e45-9131-c2c2f3f9cfbb', '2ee94cb3-8b97-4fb3-9137-3f00045a2419', '26847468-ac84-453e-ab10-f80895dd70e0', '93896448-e48d-4ecd-9934-4259d2ba3136'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:13 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:13 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:13 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Deleted volume successfully. Sep 07 17:11:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-981af3cf-32f3-417d-99e6-674c34c16752 tempest-TestMinimumBasicScenario-1524897602 None] Lock "cinder-9cf85844-804d-4304-b33a-3ab64efee6f6-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Flow 'volume_create_manager' (c252b1af-4413-4f28-ae1f-678d7767897b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f0e47-4169-4b4c-b65c-e61f4164007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (704f0e47-4169-4b4c-b65c-e61f4164007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1000140762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbb8e43-4469-494d-89da-8a829deaa872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a4db4ed425486782baca1b603d8d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:17Z,use_quota=True,user_id='13526ba5c77b449c808769cb22677080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00690755-1faa-4e19-ac03-94de1c173265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00690755-1faa-4e19-ac03-94de1c173265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fd5833-a7f8-40cc-92aa-8b8d75eba89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7fd5833-a7f8-40cc-92aa-8b8d75eba89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fbb8e43-4469-494d-89da-8a829deaa872', 'volume_name': 'volume-1fbb8e43-4469-494d-89da-8a829deaa872', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c894cd5-953d-4a08-9c81-afba69e117f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c894cd5-953d-4a08-9c81-afba69e117f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c068fa4d-9c42-423c-8eb2-3d4969519975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:16 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Volume 1fbb8e43-4469-494d-89da-8a829deaa872: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fbb8e43-4469-494d-89da-8a829deaa872', 'volume_size': 1} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1000140762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fbb8e43-4469-494d-89da-8a829deaa872,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7a4db4ed425486782baca1b603d8d6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:17Z,use_quota=True,user_id='13526ba5c77b449c808769cb22677080',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Creating volume 1fbb8e43-4469-494d-89da-8a829deaa872 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:16 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:16 devstack sudo[104291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 1073741824 Sep 07 17:11:16 devstack sudo[104291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:17 devstack sudo[104291]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 1073741824" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:17 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 Sep 07 17:11:17 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:17 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c068fa4d-9c42-423c-8eb2-3d4969519975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fbb8e43-4469-494d-89da-8a829deaa872', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ff227c-820f-4639-a33a-350b3305b2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Volume volume-1fbb8e43-4469-494d-89da-8a829deaa872 (1fbb8e43-4469-494d-89da-8a829deaa872): created successfully Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5ff227c-820f-4639-a33a-350b3305b2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Flow 'volume_create_manager' (c252b1af-4413-4f28-ae1f-678d7767897b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9656f791-6c21-4da9-ac68-18f4ab621e25 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Created volume successfully. Sep 07 17:11:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-43d542ee-8bdc-4128-b034-03b94bc9b35c req-84dcfd73-0bc2-44ba-ac03-3865bd58bbde tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-43d542ee-8bdc-4128-b034-03b94bc9b35c req-84dcfd73-0bc2-44ba-ac03-3865bd58bbde tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [req-43d542ee-8bdc-4128-b034-03b94bc9b35c req-84dcfd73-0bc2-44ba-ac03-3865bd58bbde tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-43d542ee-8bdc-4128-b034-03b94bc9b35c req-84dcfd73-0bc2-44ba-ac03-3865bd58bbde tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7', 'name': 'volume-1fbb8e43-4469-494d-89da-8a829deaa872', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd33a83c8-6d7f-4ca5-9364-530c52633f6d', 'enforce_multipath': True} {{(pid=86783) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 17:11:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-43d542ee-8bdc-4128-b034-03b94bc9b35c req-84dcfd73-0bc2-44ba-ac03-3865bd58bbde tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] attachment_update completed successfully. Sep 07 17:11:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [req-37fa307b-ed0b-47de-acf5-718609af3efe req-d8f3d9fe-fccd-4978-9512-ab2aa068cb0a tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Terminate volume connection completed successfully. Sep 07 17:11:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [req-37fa307b-ed0b-47de-acf5-718609af3efe req-d8f3d9fe-fccd-4978-9512-ab2aa068cb0a tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Deleting attachment d33a83c8-6d7f-4ca5-9364-530c52633f6d. {{(pid=86783) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "cinder-1fbb8e43-4469-494d-89da-8a829deaa872-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "cinder-1fbb8e43-4469-494d-89da-8a829deaa872-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "cinder-quobyte-1fbb8e43-4469-494d-89da-8a829deaa872" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "cinder-quobyte-1fbb8e43-4469-494d-89da-8a829deaa872" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b44a286-78bd-4289-bd9f-d34c17eac605]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:23 devstack sudo[104730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 Sep 07 17:11:23 devstack sudo[104730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:24 devstack sudo[104730]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:24 devstack sudo[104735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872 Sep 07 17:11:24 devstack sudo[104735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:24 devstack sudo[104735]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1fbb8e43-4469-494d-89da-8a829deaa872" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "cinder-quobyte-1fbb8e43-4469-494d-89da-8a829deaa872" released by "delete_volume" :: held 0.694s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Created reservations ['3a7804a1-7ae3-4545-b715-f086c95ec655', 'f8201ced-55a7-4544-9dfd-5f9ec39d4cdc', '8b587ca3-062e-4bb9-82cd-4cb39c2ee56b', '71480930-8a46-40fe-bdfd-8568a1a4eb4f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:24 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:24 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:24 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Deleted volume successfully. Sep 07 17:11:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3429972-d12c-4ea0-b24c-19a3155f3153 tempest-TestServerVolumeAttachScenarioOldVersion-1960218653 None] Lock "cinder-1fbb8e43-4469-494d-89da-8a829deaa872-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (72eb84f7-065e-4cd7-a321-a692c1b224ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ff2d85-dcd8-4a19-9941-f955694fae96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ff2d85-dcd8-4a19-9941-f955694fae96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894571841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8493e5c-3e0d-4397-82ca-38a3c1613154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:30Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330b8418-acc4-4dfa-9442-76e72c024972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (330b8418-acc4-4dfa-9442-76e72c024972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c0638b-c3fd-4ea0-a7d8-edb2fd7cfc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8c0638b-c3fd-4ea0-a7d8-edb2fd7cfc58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8493e5c-3e0d-4397-82ca-38a3c1613154', 'volume_name': 'volume-e8493e5c-3e0d-4397-82ca-38a3c1613154', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4746468-7cad-47bb-8213-822bfc302e35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4746468-7cad-47bb-8213-822bfc302e35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a891c2-611a-46de-8d78-afd93225e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Volume e8493e5c-3e0d-4397-82ca-38a3c1613154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8493e5c-3e0d-4397-82ca-38a3c1613154', 'volume_size': 1} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-894571841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8493e5c-3e0d-4397-82ca-38a3c1613154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:30Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Creating volume e8493e5c-3e0d-4397-82ca-38a3c1613154 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:29 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:29 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 1073741824 Sep 07 17:11:29 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (7d978d08-703a-4991-9f1e-aa6abe0e3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22075823-3abb-4734-813b-d03c1cd95ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22075823-3abb-4734-813b-d03c1cd95ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686367121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcc23ad-c787-4aeb-a70c-0836b601c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:30Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ffe939-428b-4fcc-83e0-f08494129ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33ffe939-428b-4fcc-83e0-f08494129ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e99bf-c640-4a8c-8c62-d70dadb327d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (449e99bf-c640-4a8c-8c62-d70dadb327d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fcc23ad-c787-4aeb-a70c-0836b601c5ba', 'volume_name': 'volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33ef46c-bb74-4774-a240-76dd7ce2a600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c33ef46c-bb74-4774-a240-76dd7ce2a600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea04a6ae-61dd-459e-ac6d-92bf977cf8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Volume 8fcc23ad-c787-4aeb-a70c-0836b601c5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba', 'volume_size': 1} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:30 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 1073741824" returned: 0 in 0.604s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:30 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 Sep 07 17:11:30 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (82d5b4c4-18e5-4d06-8d01-8072d82438a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d88bc-4914-4dfd-927b-99c9cdb963e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d88bc-4914-4dfd-927b-99c9cdb963e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262119458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d6c6a3-455d-468b-af6d-1ab0a087f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f43a0-58ce-4434-8b92-be215f72a869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e7f43a0-58ce-4434-8b92-be215f72a869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d1804-178c-4259-9ad8-f4605c2e695d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676d1804-178c-4259-9ad8-f4605c2e695d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4d6c6a3-455d-468b-af6d-1ab0a087f501', 'volume_name': 'volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecde7c1-7d0f-4b7d-b698-27146a81fb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ecde7c1-7d0f-4b7d-b698-27146a81fb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59843b6f-2b53-47da-a57c-84323cb29713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Volume a4d6c6a3-455d-468b-af6d-1ab0a087f501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501', 'volume_size': 1} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:30 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1686367121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fcc23ad-c787-4aeb-a70c-0836b601c5ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:30Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Creating volume 8fcc23ad-c787-4aeb-a70c-0836b601c5ba {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:30 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a891c2-611a-46de-8d78-afd93225e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8493e5c-3e0d-4397-82ca-38a3c1613154', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack sudo[104776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba 1073741824 Sep 07 17:11:30 devstack sudo[104776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82d238d-5e6b-45a1-a85b-aee343fda582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Volume volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 (e8493e5c-3e0d-4397-82ca-38a3c1613154): created successfully Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f82d238d-5e6b-45a1-a85b-aee343fda582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (72eb84f7-065e-4cd7-a321-a692c1b224ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d881f6a3-0775-4fe6-8623-57aa7b61bb2e tempest-CreateVolumesFromImageTest-571195066 None] Created volume successfully. Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (4fcd6f02-8f4e-4557-8ee4-3930840ebede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d864b245-e19e-4aaf-86a8-161a4e36e72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d864b245-e19e-4aaf-86a8-161a4e36e72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453852414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c362d02f-24bd-4e16-b06d-578f2b02498b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c13244-0099-49cc-8cfa-4995b35d087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c13244-0099-49cc-8cfa-4995b35d087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92c5ab-e033-4e64-abc4-b56a1ac632d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc92c5ab-e033-4e64-abc4-b56a1ac632d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c362d02f-24bd-4e16-b06d-578f2b02498b', 'volume_name': 'volume-c362d02f-24bd-4e16-b06d-578f2b02498b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7b4cb6-6718-470f-be42-35633209e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c7b4cb6-6718-470f-be42-35633209e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690d5a13-78a1-4e54-ba53-e3b7454a3f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Volume c362d02f-24bd-4e16-b06d-578f2b02498b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c362d02f-24bd-4e16-b06d-578f2b02498b', 'volume_size': 1} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:31 devstack sudo[104776]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba 1073741824" returned: 0 in 0.485s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:31 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba Sep 07 17:11:31 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (35d26877-e40b-4925-b742-46229b22523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb26cc1b-d8b3-46d8-b96a-f1a2911efae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb26cc1b-d8b3-46d8-b96a-f1a2911efae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803959003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62387b5e-a59e-4f0d-8daa-807617ce8457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62387b5e-a59e-4f0d-8daa-807617ce8457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaec260-1dd7-4b4a-96d8-8e493f1b28bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaec260-1dd7-4b4a-96d8-8e493f1b28bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1', 'volume_name': 'volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe03a83d-3f41-4fb7-b017-88ec0844bc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe03a83d-3f41-4fb7-b017-88ec0844bc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea6ed5a-4ac7-482a-ad11-b98d37842597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Volume 16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1', 'volume_size': 1} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:31 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1262119458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4d6c6a3-455d-468b-af6d-1ab0a087f501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Creating volume a4d6c6a3-455d-468b-af6d-1ab0a087f501 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea04a6ae-61dd-459e-ac6d-92bf977cf8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack sudo[104785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 1073741824 Sep 07 17:11:31 devstack sudo[104785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c96d6d5-a9a0-42cd-b771-21d62bd184bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Volume volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba (8fcc23ad-c787-4aeb-a70c-0836b601c5ba): created successfully Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c96d6d5-a9a0-42cd-b771-21d62bd184bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (7d978d08-703a-4991-9f1e-aa6abe0e3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9eee76e1-f9bc-408a-bdc7-2b4e3f531d92 tempest-CreateVolumesFromImageTest-571195066 None] Created volume successfully. Sep 07 17:11:32 devstack sudo[104785]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 1073741824" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:32 devstack sudo[104792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 Sep 07 17:11:32 devstack sudo[104792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:32 devstack sudo[104792]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] <== create_volume: return (718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-453852414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c362d02f-24bd-4e16-b06d-578f2b02498b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Creating volume c362d02f-24bd-4e16-b06d-578f2b02498b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:32 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59843b6f-2b53-47da-a57c-84323cb29713) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:32 devstack sudo[104795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b 1073741824 Sep 07 17:11:32 devstack sudo[104795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddd6cb5-1f8c-467a-b808-3ed460c01c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:32 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Volume volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 (a4d6c6a3-455d-468b-af6d-1ab0a087f501): created successfully Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dddd6cb5-1f8c-467a-b808-3ed460c01c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (82d5b4c4-18e5-4d06-8d01-8072d82438a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-912609d4-59bc-4403-a4e0-e1b43a9b6612 tempest-CreateVolumesFromImageTest-571195066 None] Created volume successfully. Sep 07 17:11:32 devstack sudo[104795]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b 1073741824" returned: 0 in 0.553s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:33 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b Sep 07 17:11:33 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:33 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.628s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-803959003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f6c5c3071f403eab9e9babfd1242aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:31Z,use_quota=True,user_id='b08204e9731d4156af31de492f0d5816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Creating volume 16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:33 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690d5a13-78a1-4e54-ba53-e3b7454a3f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c362d02f-24bd-4e16-b06d-578f2b02498b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:33 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 1073741824 Sep 07 17:11:33 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747f03ba-b119-4e28-bf17-bdd9a0794b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:33 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Volume volume-c362d02f-24bd-4e16-b06d-578f2b02498b (c362d02f-24bd-4e16-b06d-578f2b02498b): created successfully Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747f03ba-b119-4e28-bf17-bdd9a0794b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (4fcd6f02-8f4e-4557-8ee4-3930840ebede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d1ab7a50-49c6-4c5f-9219-4a138be876b8 tempest-CreateVolumesFromImageTest-571195066 None] Created volume successfully. Sep 07 17:11:33 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 1073741824" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:33 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 Sep 07 17:11:33 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:34 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ea6ed5a-4ac7-482a-ad11-b98d37842597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e3385-ce50-43f3-98e8-03c20a98564b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Volume volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 (16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1): created successfully Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (708e3385-ce50-43f3-98e8-03c20a98564b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Flow 'volume_create_manager' (35d26877-e40b-4925-b742-46229b22523a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e30b4093-394d-4e04-a8e4-954c9afa60f7 tempest-CreateVolumesFromImageTest-571195066 None] Created volume successfully. Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-quobyte-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53dbda1-f97c-44d0-baff-e0e7ffdbb101]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:35 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 Sep 07 17:11:35 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:35 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:35 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1 Sep 07 17:11:35 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:35 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1" released by "delete_volume" :: held 0.678s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Created reservations ['2c08cd29-eaa2-4229-8a0a-44ac5d456fa6', 'e0202a91-4e7a-406d-b14e-94cfb5ee806e', '6aab031f-e8c4-4e85-a242-f5c52f77e82c', 'a033ccd6-48f4-4efd-8bc4-c95534c802fb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:35 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:35 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:36 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-c362d02f-24bd-4e16-b06d-578f2b02498b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Deleted volume successfully. Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-c362d02f-24bd-4e16-b06d-578f2b02498b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbaa4847-efea-4546-956b-34b8fe84c3ad tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-16c346a9-7b2d-4bc6-a1d8-7fbd0a9e09d1-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-quobyte-c362d02f-24bd-4e16-b06d-578f2b02498b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-c362d02f-24bd-4e16-b06d-578f2b02498b" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b452a-e45c-4d0a-b13f-528aba7e6d2f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:36 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b Sep 07 17:11:36 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:36 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:36 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b Sep 07 17:11:36 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:36 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c362d02f-24bd-4e16-b06d-578f2b02498b" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-c362d02f-24bd-4e16-b06d-578f2b02498b" released by "delete_volume" :: held 0.652s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Created reservations ['c3e5d592-cf2d-408e-9ba0-bcb09c46498d', '8336c9c8-9a5b-42f6-bec8-07eb1830fa27', 'c3013bc6-7410-416e-8568-a70910aeb6df', '36c9e2f2-6939-40ec-bed7-7c3c9667ed06'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:37 devstack sudo[104835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:37 devstack sudo[104835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:37 devstack sudo[104835]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Deleted volume successfully. Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c252268-d957-4ba3-b3ea-c66790a068ef tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-c362d02f-24bd-4e16-b06d-578f2b02498b-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-a4d6c6a3-455d-468b-af6d-1ab0a087f501-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-a4d6c6a3-455d-468b-af6d-1ab0a087f501-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-quobyte-a4d6c6a3-455d-468b-af6d-1ab0a087f501" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-a4d6c6a3-455d-468b-af6d-1ab0a087f501" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b524780-a599-4d1a-8e00-3ed32110997c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:37 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 Sep 07 17:11:37 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:37 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:37 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501 Sep 07 17:11:37 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:38 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4d6c6a3-455d-468b-af6d-1ab0a087f501" returned: 0 in 0.269s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-a4d6c6a3-455d-468b-af6d-1ab0a087f501" released by "delete_volume" :: held 0.766s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Created reservations ['e4494206-559c-4db4-8b1a-e62d2918f41c', 'c2289f87-35ef-40e2-b90c-fed53f6bfeb1', '17f3b95c-562b-4c05-bb3b-74783057eb1a', '125749dc-618a-492b-8c16-d24bae9cd10a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:38 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:38 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-8fcc23ad-c787-4aeb-a70c-0836b601c5ba-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-8fcc23ad-c787-4aeb-a70c-0836b601c5ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:38 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Deleted volume successfully. Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-quobyte-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba3e5ed7-e3ca-460d-b917-a006e5c69d66 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-a4d6c6a3-455d-468b-af6d-1ab0a087f501-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad687b0-731c-425c-9d4e-10c895cedf0d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:38 devstack sudo[104850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba Sep 07 17:11:38 devstack sudo[104850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:39 devstack sudo[104850]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:39 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba Sep 07 17:11:39 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:39 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-8fcc23ad-c787-4aeb-a70c-0836b601c5ba" released by "delete_volume" :: held 0.734s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Created reservations ['734da627-d5c5-40d7-8c94-df819c9f5fc3', '46a761a7-7ae7-4851-855e-89c8d73a73de', '06771488-b67e-4670-bd67-0ad53c9636eb', 'e2f0b1bc-80f2-41d1-850a-041422cc5a72'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:39 devstack sudo[104858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:39 devstack sudo[104858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-e8493e5c-3e0d-4397-82ca-38a3c1613154-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:39 devstack sudo[104858]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Deleted volume successfully. Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-e8493e5c-3e0d-4397-82ca-38a3c1613154-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ba8b4bec-05ef-489b-87f4-b723a47e351f tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-8fcc23ad-c787-4aeb-a70c-0836b601c5ba-delete_volume" released by "delete_volume" :: held 1.260s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "cinder-quobyte-e8493e5c-3e0d-4397-82ca-38a3c1613154" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-e8493e5c-3e0d-4397-82ca-38a3c1613154" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[058cd706-622f-4293-8051-a79505ff4d9a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:40 devstack sudo[104861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 Sep 07 17:11:40 devstack sudo[104861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:40 devstack sudo[104861]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154" returned: 0 in 0.411s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:40 devstack sudo[104866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154 Sep 07 17:11:40 devstack sudo[104866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:40 devstack sudo[104866]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e8493e5c-3e0d-4397-82ca-38a3c1613154" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-quobyte-e8493e5c-3e0d-4397-82ca-38a3c1613154" released by "delete_volume" :: held 0.718s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Created reservations ['6dfb9d79-7e79-4278-affd-227a69b7344d', 'fa60d0c2-75b7-495d-b777-80e6a9fde3e1', '46618985-ee0f-44f9-9ece-80d123c18e95', '099f4d51-88f9-43f3-b57e-8290f7aafc4e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:40 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:40 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:41 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.331s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:41 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Deleted volume successfully. Sep 07 17:11:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0c8c8e66-c75d-4760-b40f-b4cd6e96f768 tempest-CreateVolumesFromImageTest-571195066 None] Lock "cinder-e8493e5c-3e0d-4397-82ca-38a3c1613154-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (62537024-bcfd-4183-852a-c91a0ed5727b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f437f-ffa3-4cc6-9bdf-a9457386f4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (587f437f-ffa3-4cc6-9bdf-a9457386f4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177456523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeedbda-47c1-49d8-8c5c-a27116fd44df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:42Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78d6e0d-cc20-4546-9d09-206e2061d4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b78d6e0d-cc20-4546-9d09-206e2061d4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bf084b-781f-442f-af82-361cb1bc96aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bf084b-781f-442f-af82-361cb1bc96aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebeedbda-47c1-49d8-8c5c-a27116fd44df', 'volume_name': 'volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f84866-1b8a-4325-8719-48098ed8a365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39f84866-1b8a-4325-8719-48098ed8a365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f01608-c801-4274-9f19-8a2068524eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume ebeedbda-47c1-49d8-8c5c-a27116fd44df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df', 'volume_size': 1} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177456523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebeedbda-47c1-49d8-8c5c-a27116fd44df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:42Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:42 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:42 devstack sudo[104908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df 1073741824 Sep 07 17:11:42 devstack sudo[104908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:42 devstack sudo[104908]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df 1073741824" returned: 0 in 0.453s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:42 devstack sudo[104913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df Sep 07 17:11:42 devstack sudo[104913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:43 devstack sudo[104913]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f01608-c801-4274-9f19-8a2068524eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da21837-cb7c-40cb-aea1-df450d9879f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:43 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df (ebeedbda-47c1-49d8-8c5c-a27116fd44df): created successfully Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da21837-cb7c-40cb-aea1-df450d9879f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (62537024-bcfd-4183-852a-c91a0ed5727b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-778248dc-c3b4-432b-95cd-80b240ec2cd3 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating offline snapshot 56f38e55-657b-4b16-9db6-dc8a2793f223 of volume ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c2fa81-4e20-4043-8f67-431a6ff412aa]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:43 devstack sudo[104916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df Sep 07 17:11:43 devstack sudo[104916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:43 devstack sudo[104916]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df" returned: 0 in 0.395s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:43 devstack sudo[104921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 1G Sep 07 17:11:43 devstack sudo[104921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (63baf33e-b979-43e0-8af1-8d6de35d5245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba0a43c-9abd-462b-9d0e-03b43d15bf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba0a43c-9abd-462b-9d0e-03b43d15bf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1643824451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceea788b-2c1b-412b-b4c3-58dd6e01b5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:44Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff056f-4eb6-49a5-a111-f0bd08a59d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06ff056f-4eb6-49a5-a111-f0bd08a59d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f4abe1-6e7d-4f77-a392-9e1849c906e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f4abe1-6e7d-4f77-a392-9e1849c906e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ceea788b-2c1b-412b-b4c3-58dd6e01b5d6', 'volume_name': 'volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193026d5-99ac-4f8f-accd-6a20e2559113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193026d5-99ac-4f8f-accd-6a20e2559113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26f223d-5bf4-4de1-adc4-180530f6139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume ceea788b-2c1b-412b-b4c3-58dd6e01b5d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6', 'volume_size': 1} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:44 devstack sudo[104921]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 1G" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:44 devstack sudo[104928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 Sep 07 17:11:44 devstack sudo[104928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:44 devstack sudo[104928]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:44 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 is being set with open permissions: ugo+rw Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:44 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 Sep 07 17:11:44 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:44 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:44 devstack sudo[104936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info Sep 07 17:11:44 devstack sudo[104936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:45 devstack sudo[104936]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info is being set with open permissions: ugo+rw Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:45 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info Sep 07 17:11:45 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:45 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.info" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1643824451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ceea788b-2c1b-412b-b4c3-58dd6e01b5d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:44Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:45 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:45 devstack sudo[104942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 1073741824 Sep 07 17:11:45 devstack sudo[104942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b892b97-bb8d-489e-9376-8b33e7f83758 tempest-CreateVolumesFromSnapshotTest-282873035 None] Create snapshot completed successfully Sep 07 17:11:45 devstack sudo[104942]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 1073741824" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:45 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 Sep 07 17:11:45 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (df9fc075-4ab2-4753-8872-f175188d0f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea63a1f-78d9-47a7-b7e4-e1a0eeee4723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ea63a1f-78d9-47a7-b7e4-e1a0eeee4723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155683389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeaed93-45b4-4b07-a707-cae551c44a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:46Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a34a31-8038-4d5a-9dc8-d9b1d7c0677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a34a31-8038-4d5a-9dc8-d9b1d7c0677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9ed04-ef16-4393-9e74-cf5611169aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c9ed04-ef16-4393-9e74-cf5611169aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdeaed93-45b4-4b07-a707-cae551c44a52', 'volume_name': 'volume-cdeaed93-45b4-4b07-a707-cae551c44a52', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e72b7d9-fcd8-4e7f-a6c8-48403ae8907e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e72b7d9-fcd8-4e7f-a6c8-48403ae8907e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9f522c-2eed-40eb-b256-a947c2f4b872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume cdeaed93-45b4-4b07-a707-cae551c44a52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdeaed93-45b4-4b07-a707-cae551c44a52', 'volume_size': 1} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:46 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.075s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1155683389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdeaed93-45b4-4b07-a707-cae551c44a52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:46Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume cdeaed93-45b4-4b07-a707-cae551c44a52 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a26f223d-5bf4-4de1-adc4-180530f6139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf22958-29e6-486f-819a-96ad36146fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 1073741824 Sep 07 17:11:46 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 (ceea788b-2c1b-412b-b4c3-58dd6e01b5d6): created successfully Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcf22958-29e6-486f-819a-96ad36146fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (63baf33e-b979-43e0-8af1-8d6de35d5245) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a4c1dca1-b30d-4037-9e52-ccb233773eb8 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (319075c2-5e73-4913-8f4c-d1d9a78d0052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9654fad1-7922-4c43-86d7-fd0e5d2d386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9654fad1-7922-4c43-86d7-fd0e5d2d386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021969880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28ce099-3033-4917-a9b2-734108003c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:46Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f738ee4c-9655-41fa-b34c-5c9eac7c7913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f738ee4c-9655-41fa-b34c-5c9eac7c7913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed829922-ab7d-41b9-8182-2042381862ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed829922-ab7d-41b9-8182-2042381862ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a28ce099-3033-4917-a9b2-734108003c75', 'volume_name': 'volume-a28ce099-3033-4917-a9b2-734108003c75', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1774ff75-2c54-43ee-b895-39091fa8d7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1774ff75-2c54-43ee-b895-39091fa8d7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824ababc-22bf-4348-90d3-11e04d7db90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume a28ce099-3033-4917-a9b2-734108003c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a28ce099-3033-4917-a9b2-734108003c75', 'volume_size': 1} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:46 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 1073741824" returned: 0 in 0.530s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (e31287ff-9baf-4bdd-891b-d599d24a2425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ab85b-a7b5-4468-aad5-cd53a918d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a50ab85b-a7b5-4468-aad5-cd53a918d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-821322166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a408fe-01ff-47e3-966f-777657b69381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:47Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92d66b2-1db9-49e0-acac-39b40646c443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 Sep 07 17:11:46 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c92d66b2-1db9-49e0-acac-39b40646c443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c081dc4a-fad8-48e5-a43c-0d50cb0bb131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c081dc4a-fad8-48e5-a43c-0d50cb0bb131) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17a408fe-01ff-47e3-966f-777657b69381', 'volume_name': 'volume-17a408fe-01ff-47e3-966f-777657b69381', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429b8d81-b616-4885-9a41-76becc2a8a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (429b8d81-b616-4885-9a41-76becc2a8a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c78655-0717-4c88-93b1-3230da56f069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume 17a408fe-01ff-47e3-966f-777657b69381: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17a408fe-01ff-47e3-966f-777657b69381', 'volume_size': 1} Sep 07 17:11:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:47 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1021969880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a28ce099-3033-4917-a9b2-734108003c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:46Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume a28ce099-3033-4917-a9b2-734108003c75 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc9f522c-2eed-40eb-b256-a947c2f4b872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdeaed93-45b4-4b07-a707-cae551c44a52', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 1073741824 Sep 07 17:11:47 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c493d45-7fbc-4f5e-9726-bc434b2b0a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-cdeaed93-45b4-4b07-a707-cae551c44a52 (cdeaed93-45b4-4b07-a707-cae551c44a52): created successfully Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c493d45-7fbc-4f5e-9726-bc434b2b0a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (df9fc075-4ab2-4753-8872-f175188d0f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (9be168c8-a69b-477a-82c8-2a79b2a1f1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77712f25-45a9-423a-b0f3-1ee9d00ee31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1015f5a9-1de9-467b-81ad-26fe5e238996 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77712f25-45a9-423a-b0f3-1ee9d00ee31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1318295942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f80200-8228-4eb3-9117-5c915abc0c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:47Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b19dad7-af33-401f-b570-28dd46bc3d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b19dad7-af33-401f-b570-28dd46bc3d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42a655-ec75-441a-9bf6-3140fc5c6c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c42a655-ec75-441a-9bf6-3140fc5c6c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72f80200-8228-4eb3-9117-5c915abc0c13', 'volume_name': 'volume-72f80200-8228-4eb3-9117-5c915abc0c13', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1bbf0a-bccc-427f-8a16-bafac58c917f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae1bbf0a-bccc-427f-8a16-bafac58c917f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30d1eed-4196-49ef-9ad2-8e638676cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume 72f80200-8228-4eb3-9117-5c915abc0c13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72f80200-8228-4eb3-9117-5c915abc0c13', 'volume_size': 1} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:47 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 1073741824" returned: 0 in 0.591s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:47 devstack sudo[104966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 Sep 07 17:11:47 devstack sudo[104966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:48 devstack sudo[104966]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-821322166',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17a408fe-01ff-47e3-966f-777657b69381,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:47Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume 17a408fe-01ff-47e3-966f-777657b69381 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:48 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 1073741824 Sep 07 17:11:48 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (24ed9599-31a8-4eca-9e62-5e891b1131e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76525d6-4cf1-4aa7-9cbc-e42add6d0d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (824ababc-22bf-4348-90d3-11e04d7db90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a28ce099-3033-4917-a9b2-734108003c75', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975cafd9-e5e0-45fd-9c4c-2c9405dac88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c76525d6-4cf1-4aa7-9cbc-e42add6d0d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1738972628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d55323-49c9-468f-b4ee-3fcf3c5295fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f4ed7-f291-4aef-996a-ac1166498c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (843f4ed7-f291-4aef-996a-ac1166498c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17e3aa-8d2b-480c-b712-e2176d6ba1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf17e3aa-8d2b-480c-b712-e2176d6ba1fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88d55323-49c9-468f-b4ee-3fcf3c5295fa', 'volume_name': 'volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d361076f-972f-449b-bbb9-afa94cb3530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d361076f-972f-449b-bbb9-afa94cb3530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606e29f-5763-4308-a0b9-b860c1a775d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume 88d55323-49c9-468f-b4ee-3fcf3c5295fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa', 'volume_size': 1} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-a28ce099-3033-4917-a9b2-734108003c75 (a28ce099-3033-4917-a9b2-734108003c75): created successfully Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (975cafd9-e5e0-45fd-9c4c-2c9405dac88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (319075c2-5e73-4913-8f4c-d1d9a78d0052) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fefb3887-c4fc-4ff0-b27d-a559e26bea3e tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (1f62d0f1-e027-40b1-8531-ec8f73905f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79944516-de95-415c-8b0f-834d065a8f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79944516-de95-415c-8b0f-834d065a8f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515617909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5bd60a-d47f-4894-a2aa-d95c49338555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e07d75-609e-4a4a-8d58-bbf352f543fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e07d75-609e-4a4a-8d58-bbf352f543fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d6c06f-cc23-43ec-8158-f5ac72d59277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56d6c06f-cc23-43ec-8158-f5ac72d59277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5bd60a-d47f-4894-a2aa-d95c49338555', 'volume_name': 'volume-0f5bd60a-d47f-4894-a2aa-d95c49338555', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf9e257-0c35-4896-a3b2-0294cf1517b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf9e257-0c35-4896-a3b2-0294cf1517b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9309c225-a896-4a4f-9bd2-ad24435aec7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume 0f5bd60a-d47f-4894-a2aa-d95c49338555: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5bd60a-d47f-4894-a2aa-d95c49338555', 'volume_size': 1} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (33df0d01-e9ce-48d1-90c5-cb3e77a9d557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2967a-06a3-4581-876d-be9ef61613c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2967a-06a3-4581-876d-be9ef61613c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-514551646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57abce9b-3b68-4c63-bbe8-b705c7991246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f788471-7ead-4ab0-8254-1fbf4dc92b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f788471-7ead-4ab0-8254-1fbf4dc92b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4507a58f-dbec-487a-8810-c4a120e05979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4507a58f-dbec-487a-8810-c4a120e05979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57abce9b-3b68-4c63-bbe8-b705c7991246', 'volume_name': 'volume-57abce9b-3b68-4c63-bbe8-b705c7991246', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b940e3a-bda4-45ef-a7f4-495ec55ee2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b940e3a-bda4-45ef-a7f4-495ec55ee2a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c79fb-bc94-473e-b2ad-5439e3eb424e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume 57abce9b-3b68-4c63-bbe8-b705c7991246: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57abce9b-3b68-4c63-bbe8-b705c7991246', 'volume_size': 1} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (cf5a257a-8af4-401e-a4d0-d0e885d755d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51b3c5-aaff-4e67-b95a-6d2143e249c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c51b3c5-aaff-4e67-b95a-6d2143e249c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984115689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f633bce4-3fc7-4e0b-a7e9-cac3caed9c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b8c68e-bb46-40f3-aee1-8040561c87d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9b8c68e-bb46-40f3-aee1-8040561c87d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb1b836-5b36-4f83-acee-e168caa849f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cb1b836-5b36-4f83-acee-e168caa849f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f633bce4-3fc7-4e0b-a7e9-cac3caed9c25', 'volume_name': 'volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f5f5fa-d1f7-41b7-aa0d-65130f7eea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f5f5fa-d1f7-41b7-aa0d-65130f7eea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184cc32c-0ca1-4844-b15e-a1afa1a99260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume f633bce4-3fc7-4e0b-a7e9-cac3caed9c25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25', 'volume_size': 1} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:48 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 1073741824" returned: 0 in 0.585s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:48 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 Sep 07 17:11:48 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (4c5c8742-8816-4b4a-b5d5-fce9c3cd97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db555374-1d5f-430b-ab36-5afb296fddaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db555374-1d5f-430b-ab36-5afb296fddaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-462620370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c8f360-f84b-4ce8-be2a-e39f4254ccdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b5ddbf-dfcc-428f-bc03-a0d2435f2b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08b5ddbf-dfcc-428f-bc03-a0d2435f2b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ede0c5-2440-4a84-a4b9-8ddf76845d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80ede0c5-2440-4a84-a4b9-8ddf76845d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1c8f360-f84b-4ce8-be2a-e39f4254ccdc', 'volume_name': 'volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49125fc2-342f-48c6-9a95-7052fee177c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49125fc2-342f-48c6-9a95-7052fee177c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66e88c7-7101-41e6-8976-a277da1048a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume e1c8f360-f84b-4ce8-be2a-e39f4254ccdc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc', 'volume_size': 1} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.662s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1318295942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72f80200-8228-4eb3-9117-5c915abc0c13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:47Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume 72f80200-8228-4eb3-9117-5c915abc0c13 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62c78655-0717-4c88-93b1-3230da56f069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17a408fe-01ff-47e3-966f-777657b69381', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c459e5a-3d83-40f7-9b7e-6bbc70f72fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 1073741824 Sep 07 17:11:49 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-17a408fe-01ff-47e3-966f-777657b69381 (17a408fe-01ff-47e3-966f-777657b69381): created successfully Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c459e5a-3d83-40f7-9b7e-6bbc70f72fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (e31287ff-9baf-4bdd-891b-d599d24a2425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9254611a-3cca-43e9-878b-442e0487d879 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (1d896135-2032-46f5-82d7-8df4c0a20a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69823f17-99ce-4d63-adac-13c6855bd1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69823f17-99ce-4d63-adac-13c6855bd1a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956703690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac6616c-5895-489e-aaab-3cf6e5866dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261ca52c-b129-46cc-ac62-af457437a175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (261ca52c-b129-46cc-ac62-af457437a175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7db21c7-fa7a-441f-b4b6-11a5e9c59bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7db21c7-fa7a-441f-b4b6-11a5e9c59bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ac6616c-5895-489e-aaab-3cf6e5866dc8', 'volume_name': 'volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2b45e-376c-494e-b330-57ff13ccec12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2b45e-376c-494e-b330-57ff13ccec12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff524485-7d63-4e5d-a13e-7df314c9400b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume 0ac6616c-5895-489e-aaab-3cf6e5866dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8', 'volume_size': 1} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:49 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 1073741824" returned: 0 in 0.442s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:49 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 Sep 07 17:11:49 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:49 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1738972628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88d55323-49c9-468f-b4ee-3fcf3c5295fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67fe3b4a93e044299e0747a48efe4065',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='51058e16f98348f884245f23441af08d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Creating volume 88d55323-49c9-468f-b4ee-3fcf3c5295fa {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a30d1eed-4196-49ef-9ad2-8e638676cda0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72f80200-8228-4eb3-9117-5c915abc0c13', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0590414b-92e9-4d67-9776-239bf09fcd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:49 devstack sudo[104989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa 1073741824 Sep 07 17:11:49 devstack sudo[104989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-72f80200-8228-4eb3-9117-5c915abc0c13 (72f80200-8228-4eb3-9117-5c915abc0c13): created successfully Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0590414b-92e9-4d67-9776-239bf09fcd26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (9be168c8-a69b-477a-82c8-2a79b2a1f1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ab1c4207-9ab9-4f9f-8e3f-00090cb51205 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:50 devstack sudo[104989]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa 1073741824" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:50 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa Sep 07 17:11:50 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:50 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1515617909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5bd60a-d47f-4894-a2aa-d95c49338555,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume 0f5bd60a-d47f-4894-a2aa-d95c49338555 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2606e29f-5763-4308-a0b9-b860c1a775d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:50 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 1073741824 Sep 07 17:11:50 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f49789-571e-4a28-b426-295cceef6522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Volume volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa (88d55323-49c9-468f-b4ee-3fcf3c5295fa): created successfully Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f49789-571e-4a28-b426-295cceef6522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Flow 'volume_create_manager' (24ed9599-31a8-4eca-9e62-5e891b1131e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-99194ed6-2ff9-49b7-a28a-6940bec34b3a tempest-CreateVolumesFromSnapshotTest-282873035 None] Created volume successfully. Sep 07 17:11:50 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 1073741824" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:51 devstack sudo[105003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 Sep 07 17:11:51 devstack sudo[105003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-88d55323-49c9-468f-b4ee-3fcf3c5295fa-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-88d55323-49c9-468f-b4ee-3fcf3c5295fa-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-88d55323-49c9-468f-b4ee-3fcf3c5295fa" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-88d55323-49c9-468f-b4ee-3fcf3c5295fa" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b55862-4dcc-4321-9c9b-2abbede3c899]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:51 devstack sudo[105003]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-514551646',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57abce9b-3b68-4c63-bbe8-b705c7991246,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:48Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume 57abce9b-3b68-4c63-bbe8-b705c7991246 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9309c225-a896-4a4f-9bd2-ad24435aec7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5bd60a-d47f-4894-a2aa-d95c49338555', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:51 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 1073741824 Sep 07 17:11:51 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b305313-7a91-4b29-afff-0c9d2ba3a023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 (0f5bd60a-d47f-4894-a2aa-d95c49338555): created successfully Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b305313-7a91-4b29-afff-0c9d2ba3a023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:51 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa Sep 07 17:11:51 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (1f62d0f1-e027-40b1-8531-ec8f73905f77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-246e88ff-a3b9-4b34-98e3-f38c2d775aa0 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:51 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:51 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa Sep 07 17:11:51 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:51 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 1073741824" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:51 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 Sep 07 17:11:51 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:51 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-88d55323-49c9-468f-b4ee-3fcf3c5295fa" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-88d55323-49c9-468f-b4ee-3fcf3c5295fa" released by "delete_volume" :: held 0.682s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['8fb9f57e-ebfd-44bf-b4ce-def6338f144c', '9b790db4-7633-47c5-88f9-e6ac0c0a4165', '74eef657-ddc1-4856-bb0f-a24223ce3831', '632ae949-af0e-4615-8fea-c1e0d94c63dc'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:52 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.315s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984115689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f633bce4-3fc7-4e0b-a7e9-cac3caed9c25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e60c79fb-bc94-473e-b2ad-5439e3eb424e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57abce9b-3b68-4c63-bbe8-b705c7991246', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:52 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 1073741824 Sep 07 17:11:52 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6ed2e-b10a-496d-bbd1-4e05a0258108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-57abce9b-3b68-4c63-bbe8-b705c7991246 (57abce9b-3b68-4c63-bbe8-b705c7991246): created successfully Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87c6ed2e-b10a-496d-bbd1-4e05a0258108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (33df0d01-e9ce-48d1-90c5-cb3e77a9d557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2c955a81-97b6-4932-b819-156384a11b7e tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:52 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-80e907ae-74e2-43af-9a91-66bbdd5c0bde tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-88d55323-49c9-468f-b4ee-3fcf3c5295fa-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-72f80200-8228-4eb3-9117-5c915abc0c13-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-72f80200-8228-4eb3-9117-5c915abc0c13-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-72f80200-8228-4eb3-9117-5c915abc0c13" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-72f80200-8228-4eb3-9117-5c915abc0c13" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d19f84-9307-4c8a-b15c-a61d03d57541]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 Sep 07 17:11:52 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 1073741824" returned: 0 in 0.532s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 Sep 07 17:11:52 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13 Sep 07 17:11:52 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.821s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-462620370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1c8f360-f84b-4ce8-be2a-e39f4254ccdc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume e1c8f360-f84b-4ce8-be2a-e39f4254ccdc {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (184cc32c-0ca1-4844-b15e-a1afa1a99260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:52 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc 1073741824 Sep 07 17:11:52 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8bcfa2-35fa-4897-a4fb-7111a4831969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 (f633bce4-3fc7-4e0b-a7e9-cac3caed9c25): created successfully Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8bcfa2-35fa-4897-a4fb-7111a4831969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (cf5a257a-8af4-401e-a4d0-d0e885d755d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce8dd7ca-1d28-404b-a0bc-cd670d6e20fd tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:53 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-72f80200-8228-4eb3-9117-5c915abc0c13" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-72f80200-8228-4eb3-9117-5c915abc0c13" released by "delete_volume" :: held 0.691s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['fe07e6bd-5c3e-4a59-897d-368327ac8bf2', '66b77c34-b55d-4078-90a1-3521b6640e1e', '5448c7b6-0b6d-476f-a40e-9e09f3e8448d', '4398ae7c-33ae-441e-ae1d-613032dfe80f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:53 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:53 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:53 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc 1073741824" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:53 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc Sep 07 17:11:53 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:53 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-17a408fe-01ff-47e3-966f-777657b69381-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-17a408fe-01ff-47e3-966f-777657b69381-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ce24d571-02da-4000-a955-e634512fd286 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-72f80200-8228-4eb3-9117-5c915abc0c13-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-17a408fe-01ff-47e3-966f-777657b69381" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-17a408fe-01ff-47e3-966f-777657b69381" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f2d81e-1736-499c-8aca-52c231961a7b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:53 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956703690',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ac6616c-5895-489e-aaab-3cf6e5866dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dff0425f289d4aebb70a3f0ea8b83d68',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:11:49Z,use_quota=True,user_id='fb93e4715fd7409c9bbd68a0927f777a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Creating volume 0ac6616c-5895-489e-aaab-3cf6e5866dc8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:11:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:53 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 1073741824 Sep 07 17:11:53 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c66e88c7-7101-41e6-8976-a277da1048a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d136251-c2d3-4f62-914e-d03face0b6c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc (e1c8f360-f84b-4ce8-be2a-e39f4254ccdc): created successfully Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d136251-c2d3-4f62-914e-d03face0b6c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (4c5c8742-8816-4b4a-b5d5-fce9c3cd97cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:53 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 Sep 07 17:11:53 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3869722a-a07e-4a50-acbe-d878e72ebf69 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:54 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:54 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381 Sep 07 17:11:54 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:54 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 1073741824" returned: 0 in 0.422s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:54 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 Sep 07 17:11:54 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:54 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-17a408fe-01ff-47e3-966f-777657b69381" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-17a408fe-01ff-47e3-966f-777657b69381" released by "delete_volume" :: held 0.710s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['31ab874b-ef2a-4d2b-901a-48ab80740e37', 'e769ba44-67ad-40f8-946a-838b2efa1d09', '532e949b-3682-444e-b783-41d104a8ce1c', '878d8ba2-95a1-499c-820c-0099ef77a7ae'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:54 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff524485-7d63-4e5d-a13e-7df314c9400b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67887f33-7b19-469b-9981-6ef4e84d558a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:11:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Volume volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 (0ac6616c-5895-489e-aaab-3cf6e5866dc8): created successfully Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67887f33-7b19-469b-9981-6ef4e84d558a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Flow 'volume_create_manager' (1d896135-2032-46f5-82d7-8df4c0a20a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3d17cadb-0c37-4d88-8e7a-8ea48f601151 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created volume successfully. Sep 07 17:11:54 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:54 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-a28ce099-3033-4917-a9b2-734108003c75-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-a28ce099-3033-4917-a9b2-734108003c75-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:54 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d47324ee-b41d-49e9-bc23-de2c7e97d2af tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-17a408fe-01ff-47e3-966f-777657b69381-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-a28ce099-3033-4917-a9b2-734108003c75" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-a28ce099-3033-4917-a9b2-734108003c75" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a063cb-1b60-4295-8646-ec32cbf26aa3]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-0ac6616c-5895-489e-aaab-3cf6e5866dc8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-0ac6616c-5895-489e-aaab-3cf6e5866dc8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:54 devstack sudo[105082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 Sep 07 17:11:54 devstack sudo[105082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-0ac6616c-5895-489e-aaab-3cf6e5866dc8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-0ac6616c-5895-489e-aaab-3cf6e5866dc8" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8bb100-6c77-4b93-adb6-2d9ee466da5f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:55 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 Sep 07 17:11:55 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:55 devstack sudo[105082]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:55 devstack sudo[105089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75 Sep 07 17:11:55 devstack sudo[105089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:55 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:55 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8 Sep 07 17:11:55 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:55 devstack sudo[105089]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a28ce099-3033-4917-a9b2-734108003c75" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-a28ce099-3033-4917-a9b2-734108003c75" released by "delete_volume" :: held 0.694s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['71e45345-8572-4bff-8c4d-b70c3cd23ab6', '59a82724-d314-475c-b1fa-bea49a56eb3a', '1373169d-5e5a-4187-8fe8-03686cc1e222', 'bd22bfa6-5d3a-48ff-b0c9-0ac5df4c544f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:55 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:55 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:55 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0ac6616c-5895-489e-aaab-3cf6e5866dc8" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-0ac6616c-5895-489e-aaab-3cf6e5866dc8" released by "delete_volume" :: held 0.699s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['420888f1-90e5-47ba-8c00-efb5dea64a27', 'b8befb37-c054-403f-87c2-b5e465b2c161', '7fcf098a-41ef-4a8e-a1f1-34a67b23d3ae', '93969042-05da-4888-ad66-76c2504ee734'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:55 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:55 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:55 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-cdeaed93-45b4-4b07-a707-cae551c44a52-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4f55db5f-243c-43a5-b02d-9d6b7c5715a7 tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-a28ce099-3033-4917-a9b2-734108003c75-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-cdeaed93-45b4-4b07-a707-cae551c44a52-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-cdeaed93-45b4-4b07-a707-cae551c44a52" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-cdeaed93-45b4-4b07-a707-cae551c44a52" acquired by "delete_volume" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[42dd1b35-f95c-4465-9295-23fad78a5163]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-51f6e340-cab1-4139-be50-007ec89b0ed2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-0ac6616c-5895-489e-aaab-3cf6e5866dc8-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:56 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 Sep 07 17:11:56 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[037f244c-ac00-4f05-bcc2-59a3d587f6e2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc Sep 07 17:11:56 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:56 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52 Sep 07 17:11:56 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:56 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc Sep 07 17:11:56 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:56 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-cdeaed93-45b4-4b07-a707-cae551c44a52" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-cdeaed93-45b4-4b07-a707-cae551c44a52" released by "delete_volume" :: held 0.704s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['6ec94f0f-55dc-4f7d-89b8-235af46977e3', 'a29da667-f5d7-4fae-9657-0538fdcf976c', 'ac5aa25d-9198-4b09-831c-c831397b1bf9', '57ce5f1f-3c6d-4a62-8ffb-18743352cd38'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" returned: 0 in 0.264s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:56 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc" released by "delete_volume" :: held 0.660s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:56 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['64e79d7f-8f67-4d30-896c-e738ee00ec81', 'f6b1f14f-86e0-4459-bfe0-38edf56be31a', '0746a1c3-5919-4fd2-9e2b-4fbddca780f5', 'c3a2903b-2069-42d4-be13-353245c6ad6d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:56 devstack sudo[105122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:56 devstack sudo[105122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-56f38e55-657b-4b16-9db6-dc8a2793f223-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:57 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-56f38e55-657b-4b16-9db6-dc8a2793f223-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc753a60-30f3-4ec9-b36c-e20e283354ad tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-cdeaed93-45b4-4b07-a707-cae551c44a52-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-56f38e55-657b-4b16-9db6-dc8a2793f223" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-56f38e55-657b-4b16-9db6-dc8a2793f223" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleting offline snapshot 56f38e55-657b-4b16-9db6-dc8a2793f223 of volume ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] snapshot_file for this snap is: volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3d4a26-19e7-4f1b-a17e-ab2b2f7bd5bb]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:57 devstack sudo[105122]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-108e1313-9187-4bf9-a0f8-d808d10e26f2 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-e1c8f360-f84b-4ce8-be2a-e39f4254ccdc-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:57 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 Sep 07 17:11:57 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[62052bf7-b312-407c-ac48-f6e631e7a9e4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:57 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 Sep 07 17:11:57 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:57 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a762ca8-4380-4a8f-bc44-55095029db11]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:57 devstack sudo[105133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df Sep 07 17:11:57 devstack sudo[105133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:57 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" returned: 0 in 0.375s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:57 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25 Sep 07 17:11:57 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:57 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack sudo[105133]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25" released by "delete_volume" :: held 0.654s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:58 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 Sep 07 17:11:58 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['1447efe3-7aa7-44ad-8432-ccb50fb6aab7', '03a492fe-8491-4881-b857-3bea0bad836b', '3a7fb6f4-9f73-4f97-8989-bf5265c15589', '55194ab5-824b-499e-8272-db5149d9998a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:58 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:58 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:58 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:58 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223 Sep 07 17:11:58 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:58 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-60007196-fdb4-40c4-8a7c-f1330d0628bf tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-f633bce4-3fc7-4e0b-a7e9-cac3caed9c25-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-57abce9b-3b68-4c63-bbe8-b705c7991246-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-57abce9b-3b68-4c63-bbe8-b705c7991246-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-57abce9b-3b68-4c63-bbe8-b705c7991246" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-57abce9b-3b68-4c63-bbe8-b705c7991246" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[149a7bf4-6a76-4450-bbfb-4d9acfebaed0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:58 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df.56f38e55-657b-4b16-9db6-dc8a2793f223" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:58 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 Sep 07 17:11:58 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-56f38e55-657b-4b16-9db6-dc8a2793f223" released by "_delete_snapshot" :: held 1.538s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" released by "delete_snapshot" :: held 1.561s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['257f2710-5de4-4818-a34f-379391f3651b', '70f7a848-1753-4281-b438-47bd0e4ce2f9', '8cafd77f-0d2a-4765-a805-a083ccfce33b', '6346bf06-672b-40ad-a33a-8d6f45f152c2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Delete snapshot completed successfully. Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f0492ed0-646a-46f3-accb-c332e1118c5c tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-56f38e55-657b-4b16-9db6-dc8a2793f223-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:58 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:58 devstack sudo[105161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246 Sep 07 17:11:58 devstack sudo[105161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:59 devstack sudo[105161]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-57abce9b-3b68-4c63-bbe8-b705c7991246" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-57abce9b-3b68-4c63-bbe8-b705c7991246" released by "delete_volume" :: held 0.639s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['86635faa-dc32-4a92-a14c-4fc1cb7f8fe3', '11ab6d43-e8e8-448b-b2bc-4ee509dc8002', 'd33d6bdd-a2fa-43b3-8db8-fde5176bb833', '1a3b103f-368b-483a-ac41-718bf18d0933'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-ebeedbda-47c1-49d8-8c5c-a27116fd44df-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-ebeedbda-47c1-49d8-8c5c-a27116fd44df-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:59 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:11:59 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[620c4085-1e51-481b-9db6-b1e79b9630cf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:59 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df Sep 07 17:11:59 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:59 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:11:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-0f5bd60a-d47f-4894-a2aa-d95c49338555-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5063cec9-268c-46c2-8f17-85a31b604f36 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-57abce9b-3b68-4c63-bbe8-b705c7991246-delete_volume" released by "delete_volume" :: held 1.158s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-0f5bd60a-d47f-4894-a2aa-d95c49338555-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-0f5bd60a-d47f-4894-a2aa-d95c49338555" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-0f5bd60a-d47f-4894-a2aa-d95c49338555" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e58b45-35ac-479b-a3ab-680fa5285b08]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:59 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:11:59 devstack sudo[105174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df Sep 07 17:11:59 devstack sudo[105174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:59 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 Sep 07 17:11:59 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:11:59 devstack sudo[105174]: pam_unix(sudo:session): session closed for user root Sep 07 17:11:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ebeedbda-47c1-49d8-8c5c-a27116fd44df" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-quobyte-ebeedbda-47c1-49d8-8c5c-a27116fd44df" released by "delete_volume" :: held 0.680s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Created reservations ['3f17e847-dc00-440e-a9f2-1150ff1a7c12', '7e74080f-40c9-425f-b04d-102cd9d86a4e', '14c8dc8d-200d-4e4f-a116-d9a95aee3d41', 'f6ad10c7-4deb-46b5-a6c4-6d53da7077b9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:00 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:00 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555 Sep 07 17:12:00 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:00 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:00 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:00 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-0f5bd60a-d47f-4894-a2aa-d95c49338555" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-0f5bd60a-d47f-4894-a2aa-d95c49338555" released by "delete_volume" :: held 0.680s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:00 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Deleted volume successfully. Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['30e165a5-e888-474c-ad07-a3a4d3008581', '98f9797a-62c2-499d-8362-ab0364d9db00', '8bf3ceee-58c6-44d4-a875-d7b3f48a6007', '4e37ca5e-a34c-456f-acff-56a9e6282b36'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-06485439-b36e-48e8-a6b3-41899c6d08fc tempest-CreateVolumesFromSnapshotTest-282873035 None] Lock "cinder-ebeedbda-47c1-49d8-8c5c-a27116fd44df-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:00 devstack sudo[105187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:00 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:00 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e4f181e8-c757-446d-a150-18b489c381dc tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-0f5bd60a-d47f-4894-a2aa-d95c49338555-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "cinder-quobyte-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ae276c-4df5-4760-98b9-df1dea6797d7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:01 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 Sep 07 17:12:01 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:01 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" returned: 0 in 0.398s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:01 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6 Sep 07 17:12:01 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:01 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-quobyte-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6" released by "delete_volume" :: held 0.695s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Created reservations ['eca90b49-0bb1-48c7-80b8-c8a9e13f6d53', '98557838-b636-4f3b-adac-2fb1250e5974', '685c6038-c2e1-4aef-90f9-7ee95504a85d', 'a83ba143-051a-4b3d-8c0c-7029daacc9c5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:01 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:01 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:01 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Deleted volume successfully. Sep 07 17:12:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e9d3f963-c36a-4200-8588-5faf558a47e9 tempest-CreateVolumesFromSourceVolumeTest-1784711759 None] Lock "cinder-ceea788b-2c1b-412b-b4c3-58dd6e01b5d6-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Flow 'volume_create_manager' (7e015cf9-7a48-4802-9faf-09dd4d55f8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b36068-cf97-454d-977d-61458f547734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96b36068-cf97-454d-977d-61458f547734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1464931063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bd5552-4b54-4f02-a0e3-c883c5478f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82e8956d02041f99162103cbc9142a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:05Z,use_quota=True,user_id='0163138c860d46f0bc3f45ecdafa2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062bb8f2-4bfc-449f-bb45-2899d0fca246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062bb8f2-4bfc-449f-bb45-2899d0fca246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94909651-f734-4a9f-a4ea-4a5f139d4bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94909651-f734-4a9f-a4ea-4a5f139d4bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01bd5552-4b54-4f02-a0e3-c883c5478f1d', 'volume_name': 'volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13529f4-e5ff-47e6-a823-9fb6e1ac8bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b13529f4-e5ff-47e6-a823-9fb6e1ac8bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccecf0a-db35-412f-8545-a59f985abd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Volume 01bd5552-4b54-4f02-a0e3-c883c5478f1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d', 'volume_size': 1} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1464931063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01bd5552-4b54-4f02-a0e3-c883c5478f1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82e8956d02041f99162103cbc9142a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:05Z,use_quota=True,user_id='0163138c860d46f0bc3f45ecdafa2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Creating volume 01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:05 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d 1073741824 Sep 07 17:12:05 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:05 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d 1073741824" returned: 0 in 0.456s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:05 devstack sudo[105208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:05 devstack sudo[105208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:05 devstack sudo[105208]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dccecf0a-db35-412f-8545-a59f985abd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2a415-f045-4ea7-86bb-0b1397f02624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Volume volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d (01bd5552-4b54-4f02-a0e3-c883c5478f1d): created successfully Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75d2a415-f045-4ea7-86bb-0b1397f02624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Flow 'volume_create_manager' (7e015cf9-7a48-4802-9faf-09dd4d55f8ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c0c88f6e-ddaf-4afe-8cd3-964902272660 tempest-VolumeDependencyTests-1072112776 None] Created volume successfully. Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=152,cinder:UPDATE=221,cinder:INSERT=53,cinder:DELETE=20 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Creating offline snapshot 54de78fb-7532-428f-a93e-93ad9211b950 of volume 01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7629a5f5-1f48-4f5f-ad2f-8b02e00e4f9e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:07 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:07 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:07 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:07 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 1G Sep 07 17:12:07 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:07 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 1G" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:07 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:07 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:08 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 is being set with open permissions: ugo+rw Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:08 devstack sudo[105228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:08 devstack sudo[105228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:08 devstack sudo[105228]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=152,cinder:INSERT=47,cinder:UPDATE=215,cinder:DELETE=19 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:08 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info Sep 07 17:12:08 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:08 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:08 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info is being set with open permissions: ugo+rw Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:08 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info Sep 07 17:12:08 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:08 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.info" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.817s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:08 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-86fd9408-848a-46c4-b0dd-65b36623bc66 tempest-VolumeDependencyTests-1072112776 None] Create snapshot completed successfully Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Flow 'volume_create_manager' (879bd2b2-8d6f-48ad-b229-a61b5dbc50c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f632e7f6-ecee-43ab-a0a1-4501e5bb3a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f632e7f6-ecee-43ab-a0a1-4501e5bb3a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1122648019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=814b9984-e312-427c-a1ba-78a8f309c1a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d82e8956d02041f99162103cbc9142a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=54de78fb-7532-428f-a93e-93ad9211b950,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:10Z,use_quota=True,user_id='0163138c860d46f0bc3f45ecdafa2ff0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd7acf-f8fd-438c-8626-52f839c8800f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7bd7acf-f8fd-438c-8626-52f839c8800f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65c57a3-a104-47c9-8ccf-77e0c9d6f7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65c57a3-a104-47c9-8ccf-77e0c9d6f7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '814b9984-e312-427c-a1ba-78a8f309c1a3', 'volume_name': 'volume-814b9984-e312-427c-a1ba-78a8f309c1a3', 'volume_size': 1, 'snapshot_id': '54de78fb-7532-428f-a93e-93ad9211b950'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538994c5-da7d-415d-9000-1451f766e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (538994c5-da7d-415d-9000-1451f766e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205b1396-77c7-4b95-889f-9ee2980e7714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Volume 814b9984-e312-427c-a1ba-78a8f309c1a3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-814b9984-e312-427c-a1ba-78a8f309c1a3', 'volume_size': 1, 'snapshot_id': '54de78fb-7532-428f-a93e-93ad9211b950'} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950-814b9984-e312-427c-a1ba-78a8f309c1a3" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:09 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:09 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950-814b9984-e312-427c-a1ba-78a8f309c1a3" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Creating volume 814b9984-e312-427c-a1ba-78a8f309c1a3 from snapshot 54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] snapshot: 54de78fb-7532-428f-a93e-93ad9211b950, volume: 814b9984-e312-427c-a1ba-78a8f309c1a3, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae193e4-7b5b-41a1-b80a-b80a0faaf134]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:10 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:10 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:10 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:12:10 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b2a460-30cc-4099-86da-2d3d579e9985]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:10 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:10 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:10 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.383s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:12:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:10 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 Sep 07 17:12:10 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:14 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3" returned: 0 in 3.969s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d, size 1024.00 MB, duration 3.97 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:12:14 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Converted 1024.00 MB image at 257.92 MB/s Sep 07 17:12:14 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 is being set with open permissions: ugo+rw Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:14 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 Sep 07 17:12:14 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:14 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" released by "_copy_volume_from_snapshot" :: held 5.051s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950-814b9984-e312-427c-a1ba-78a8f309c1a3" released by "_create_volume_from_snapshot" :: held 5.132s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.199s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205b1396-77c7-4b95-889f-9ee2980e7714) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-814b9984-e312-427c-a1ba-78a8f309c1a3', 'volume_size': 1, 'snapshot_id': '54de78fb-7532-428f-a93e-93ad9211b950'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e02cc3-00fd-4ada-9950-037be1e469ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:15 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Volume volume-814b9984-e312-427c-a1ba-78a8f309c1a3 (814b9984-e312-427c-a1ba-78a8f309c1a3): created successfully Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90e02cc3-00fd-4ada-9950-037be1e469ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Flow 'volume_create_manager' (879bd2b2-8d6f-48ad-b229-a61b5dbc50c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6dcf42bd-0296-442d-b7fe-a65994163c7b tempest-VolumeDependencyTests-1072112776 None] Created volume successfully. Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-54de78fb-7532-428f-a93e-93ad9211b950-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-54de78fb-7532-428f-a93e-93ad9211b950-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Deleting offline snapshot 54de78fb-7532-428f-a93e-93ad9211b950 of volume 01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] snapshot_file for this snap is: volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8409fa6-2d57-408e-87aa-eaf5e5322c55]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:15 devstack sudo[105269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:15 devstack sudo[105269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:15 devstack sudo[105269]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0515201c-f545-4f53-829c-9d8ce5fae2b7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:15 devstack sudo[105274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:15 devstack sudo[105274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:16 devstack sudo[105274]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.520s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:16 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:16 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:16 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:16 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950 Sep 07 17:12:16 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:16 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d.54de78fb-7532-428f-a93e-93ad9211b950" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-54de78fb-7532-428f-a93e-93ad9211b950" released by "_delete_snapshot" :: held 1.530s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" released by "delete_snapshot" :: held 1.554s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:16 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Created reservations ['5cd0405c-1d38-42ae-998a-f8af80df16c6', 'f9b33558-29ae-4d20-a649-e9f8e0d84985', '991d2b59-df07-4343-9351-cae0367900c7', 'd59d9d03-f5d3-46fb-b9eb-f287351f696c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Delete snapshot completed successfully. Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ea20c047-eb48-4326-bbaf-d61fb70e1569 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-54de78fb-7532-428f-a93e-93ad9211b950-delete_snapshot" released by "delete_snapshot" :: held 1.688s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-01bd5552-4b54-4f02-a0e3-c883c5478f1d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-01bd5552-4b54-4f02-a0e3-c883c5478f1d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbbad7-e90f-4f42-b214-b907d4584b21]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:17 devstack sudo[105287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:17 devstack sudo[105287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:17 devstack sudo[105287]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:18 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d Sep 07 17:12:18 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:18 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-01bd5552-4b54-4f02-a0e3-c883c5478f1d" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-01bd5552-4b54-4f02-a0e3-c883c5478f1d" released by "delete_volume" :: held 0.669s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Created reservations ['607b5faf-642d-4c5a-bada-c68c56d49567', 'bc122142-3c6e-4b6b-b197-3523ce6529c5', 'daec9712-c60f-4cd3-9261-5429e803711b', '2def96ff-2f16-4bf7-ab38-45c21989dc96'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:18 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:18 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:18 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Deleted volume successfully. Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-e556cb08-1215-4769-bdb6-8d1db4feffb2 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-01bd5552-4b54-4f02-a0e3-c883c5478f1d-delete_volume" released by "delete_volume" :: held 1.110s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-814b9984-e312-427c-a1ba-78a8f309c1a3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-814b9984-e312-427c-a1ba-78a8f309c1a3-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e8dec5-8c81-4727-861d-eb537ef3832f]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:18 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 Sep 07 17:12:18 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:19 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:19 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3 Sep 07 17:12:19 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:19 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-814b9984-e312-427c-a1ba-78a8f309c1a3" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-quobyte-814b9984-e312-427c-a1ba-78a8f309c1a3" released by "delete_volume" :: held 0.630s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Created reservations ['722a0440-4cf1-4de1-bacf-074b30f544dc', 'c5716bef-3cf0-4a90-b933-0c8de6867693', '0d640cf2-f516-4471-8a5d-ae5a985ebdef', 'ff37f249-8f25-422b-af8d-7ab120f5fa54'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:19 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:19 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:19 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Deleted volume successfully. Sep 07 17:12:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1a66caf7-68b6-4b41-b1bc-2e9e60642334 tempest-VolumeDependencyTests-1072112776 None] Lock "cinder-814b9984-e312-427c-a1ba-78a8f309c1a3-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Flow 'volume_create_manager' (2073ae2c-2725-46d8-af47-0029a71267a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d780e-7efa-49ef-b105-60bdef74d667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d780e-7efa-49ef-b105-60bdef74d667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c335c01f-dfbe-45e1-8e4a-26797143498b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb3cc7cdb23458ca1e4eb6bed5c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:25Z,use_quota=True,user_id='9c0b8e2f57f64a9bbda6d6314e85b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cc6164-37bd-4bdf-bd79-ae2687256d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28cc6164-37bd-4bdf-bd79-ae2687256d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c2f7a9-22df-4626-98d5-cb1170ac8466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:24 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54c2f7a9-22df-4626-98d5-cb1170ac8466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c335c01f-dfbe-45e1-8e4a-26797143498b', 'volume_name': 'volume-c335c01f-dfbe-45e1-8e4a-26797143498b', 'volume_size': 1, 'image_id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eb89bcbaacc90ff356f86ed49cae2ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1cb3cc7cdb23458ca1e4eb6bed5c4e1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20ff6eb4937a68005d870816eb49c0d1c4ffe4c71f8dd950d724044c810495552dfea0f9d7dbbc3696e3d224057933cde81b38c73e9aab8e15186c47929c8107', 'id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'created_at': datetime.datetime(2026, 9, 7, 15, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143f848-fa0e-48c0-b4a8-c228c8985953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7143f848-fa0e-48c0-b4a8-c228c8985953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f6c0c3-ce9e-450b-ae92-efed6aecb3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Volume c335c01f-dfbe-45e1-8e4a-26797143498b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c335c01f-dfbe-45e1-8e4a-26797143498b', 'volume_size': 1, 'image_id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eb89bcbaacc90ff356f86ed49cae2ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1cb3cc7cdb23458ca1e4eb6bed5c4e1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20ff6eb4937a68005d870816eb49c0d1c4ffe4c71f8dd950d724044c810495552dfea0f9d7dbbc3696e3d224057933cde81b38c73e9aab8e15186c47929c8107', 'id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'created_at': datetime.datetime(2026, 9, 7, 15, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af/file', 'properties': {}}, 'image_service': } Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Trying to clone c335c01f-dfbe-45e1-8e4a-26797143498b from image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af at location (None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:12:25 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c80422e-9315-4d9e-a921-f7f004be0feb]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:25 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:25 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:25 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 0 in 0.319s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:25 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:25 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:25 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 1 in 0.336s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Temporary image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af is fetched for user 9c0b8e2f57f64a9bbda6d6314e85b1f8. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49f4623-4aac-4109-9f87-1d6c624e39b9]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:26 devstack sudo[105322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:26 devstack sudo[105322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:26 devstack sudo[105322]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:26 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:26 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:26 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 1 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c335c01f-dfbe-45e1-8e4a-26797143498b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cb3cc7cdb23458ca1e4eb6bed5c4e1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:25Z,use_quota=True,user_id='9c0b8e2f57f64a9bbda6d6314e85b1f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Creating volume c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:26 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1073741824 Sep 07 17:12:26 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:27 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1073741824" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:27 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b Sep 07 17:12:27 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:27 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b" returned: 0 in 0.233s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] <== create_volume: return (682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Attempting download of 185d256f-5c1e-4ab2-8ccd-95b803e1e5af ((None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}])) to volume c335c01f-dfbe-45e1-8e4a-26797143498b. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3495896c-21d9-43b6-ba66-298d57439545]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:27 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg Sep 07 17:12:27 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:27 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:27 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg Sep 07 17:12:27 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:27 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg" returned: 1 in 0.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_c7_zf0pg' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[732af68d-32d0-4bb2-892d-e061a80b988d]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:28 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:28 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:28 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:28 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD Sep 07 17:12:28 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:28 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD" returned: 1 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] 185d256f-5c1e-4ab2-8ccd-95b803e1e5af was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:12:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:28 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b Sep 07 17:12:28 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:29 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_185d256f-5c1e-4ab2-8ccd-95b803e1e5af_ylaroea1devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:12:29 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:29 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1G Sep 07 17:12:29 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:29 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b 1G" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Downloaded image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af ((None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}])) to volume c335c01f-dfbe-45e1-8e4a-26797143498b successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Temporary image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af for user 9c0b8e2f57f64a9bbda6d6314e85b1f8 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Marking volume c335c01f-dfbe-45e1-8e4a-26797143498b as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Copying metadata from image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af to c335c01f-dfbe-45e1-8e4a-26797143498b. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Creating volume glance metadata for volume c335c01f-dfbe-45e1-8e4a-26797143498b backed by image 185d256f-5c1e-4ab2-8ccd-95b803e1e5af with: {'image_id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4eb89bcbaacc90ff356f86ed49cae2ce', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02f6c0c3-ce9e-450b-ae92-efed6aecb3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c335c01f-dfbe-45e1-8e4a-26797143498b', 'volume_size': 1, 'image_id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4eb89bcbaacc90ff356f86ed49cae2ce', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1cb3cc7cdb23458ca1e4eb6bed5c4e1c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20ff6eb4937a68005d870816eb49c0d1c4ffe4c71f8dd950d724044c810495552dfea0f9d7dbbc3696e3d224057933cde81b38c73e9aab8e15186c47929c8107', 'id': '185d256f-5c1e-4ab2-8ccd-95b803e1e5af', 'created_at': datetime.datetime(2026, 9, 7, 15, 12, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 12, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/185d256f-5c1e-4ab2-8ccd-95b803e1e5af/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0321fc40-1f19-4a08-b195-331e670413d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Volume volume-c335c01f-dfbe-45e1-8e4a-26797143498b (c335c01f-dfbe-45e1-8e4a-26797143498b): created successfully Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0321fc40-1f19-4a08-b195-331e670413d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Flow 'volume_create_manager' (2073ae2c-2725-46d8-af47-0029a71267a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f7a24989-1e58-4592-9675-b67ff522aabf tempest-VolumeImageDependencyTests-299848937 None] Created volume successfully. Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Acquiring lock "cinder-c335c01f-dfbe-45e1-8e4a-26797143498b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "cinder-c335c01f-dfbe-45e1-8e4a-26797143498b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Acquiring lock "cinder-quobyte-c335c01f-dfbe-45e1-8e4a-26797143498b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "cinder-quobyte-c335c01f-dfbe-45e1-8e4a-26797143498b" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d188a40-3327-44d5-80f9-bd5db4f5ca55]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:30 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b Sep 07 17:12:30 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:30 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:30 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b Sep 07 17:12:30 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:30 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c335c01f-dfbe-45e1-8e4a-26797143498b" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "cinder-quobyte-c335c01f-dfbe-45e1-8e4a-26797143498b" released by "delete_volume" :: held 0.634s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Created reservations ['44b35e93-45a4-4908-bb09-82a6f7d25694', 'a7a080fd-de85-4177-85fa-7844c8a6e8e4', '3840fc18-ee49-4e83-9e39-4a2237fa6469', '2f10ccd8-c5f7-46cd-b294-0d25d262eb9f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:30 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:30 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:31 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Deleted volume successfully. Sep 07 17:12:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5122146e-6e51-4cc1-b53b-0318eb68b728 tempest-VolumeImageDependencyTests-299848937 None] Lock "cinder-c335c01f-dfbe-45e1-8e4a-26797143498b-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Flow 'volume_create_manager' (8ad587fd-c88f-489e-b8e1-c58620f0120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbe4f3a-26ce-4c60-bae6-0a9952c16e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbe4f3a-26ce-4c60-bae6-0a9952c16e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049353206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a6170c-3bc9-42ab-aba8-218f7aafa8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416cdc19942e4ac3a504145a215b4d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:35Z,use_quota=True,user_id='f2a33769c61a416f9b90d6309d4bd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc4110a-76a5-4b62-ab4b-c6d41ffd171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dc4110a-76a5-4b62-ab4b-c6d41ffd171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea66a3b4-e1fb-4f5f-9741-2444ee579749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea66a3b4-e1fb-4f5f-9741-2444ee579749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1a6170c-3bc9-42ab-aba8-218f7aafa8e1', 'volume_name': 'volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bea1b-dc7a-4652-81a9-7d4aa5a73061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511bea1b-dc7a-4652-81a9-7d4aa5a73061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1b81e7-0cc6-4dbd-9e01-e4af56966361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:34 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Volume d1a6170c-3bc9-42ab-aba8-218f7aafa8e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1', 'volume_size': 1} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049353206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1a6170c-3bc9-42ab-aba8-218f7aafa8e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416cdc19942e4ac3a504145a215b4d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:35Z,use_quota=True,user_id='f2a33769c61a416f9b90d6309d4bd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Creating volume d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:34 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:34 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 1073741824 Sep 07 17:12:34 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:35 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 1073741824" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:35 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 Sep 07 17:12:35 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:35 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] <== create_volume: return (669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.672s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1b81e7-0cc6-4dbd-9e01-e4af56966361) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6173c1-1d39-46ca-8452-0eefe6da977b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Volume volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 (d1a6170c-3bc9-42ab-aba8-218f7aafa8e1): created successfully Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c6173c1-1d39-46ca-8452-0eefe6da977b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Flow 'volume_create_manager' (8ad587fd-c88f-489e-b8e1-c58620f0120e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5b461d75-6af7-40d2-bd6e-bbfc2d3e38d8 tempest-ProjectReaderTests-1830746291 None] Created volume successfully. Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Acquiring lock "cinder-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "cinder-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Acquiring lock "cinder-quobyte-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "cinder-quobyte-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" acquired by "delete_volume" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9859b5-64a4-4fff-9f6d-516ccd34471e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:36 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 Sep 07 17:12:36 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:36 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:36 devstack sudo[105392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1 Sep 07 17:12:36 devstack sudo[105392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:36 devstack sudo[105392]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "cinder-quobyte-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1" released by "delete_volume" :: held 0.642s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Created reservations ['7cf614f9-290a-4f6e-ab73-de347a7f45d6', '8de8cd51-8a96-49c7-9c98-e099cd68b407', '39d5ae6c-23c8-42dc-af94-1aeb7ed67ad6', 'b66d8989-12c9-46a6-8a35-4300555cbb73'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:36 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:36 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:36 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.230s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Deleted volume successfully. Sep 07 17:12:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8a46737c-4cd3-4df0-a8b4-855a0733501f tempest-ProjectReaderTests-1830746291 None] Lock "cinder-d1a6170c-3bc9-42ab-aba8-218f7aafa8e1-delete_volume" released by "delete_volume" :: held 1.059s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Flow 'volume_create_manager' (c2ba3722-7a16-4d59-a4f0-4e2cf7177e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76b959b-a2e0-4e3f-8f9a-5432827668b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d76b959b-a2e0-4e3f-8f9a-5432827668b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209243146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c739e-4516-4196-bcb4-0585417ee41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416cdc19942e4ac3a504145a215b4d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:37Z,use_quota=True,user_id='f2a33769c61a416f9b90d6309d4bd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d2260-986f-4953-829b-cf532721f1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a8d2260-986f-4953-829b-cf532721f1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8fc6f7-4fe2-4e76-a998-0e594395c628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8fc6f7-4fe2-4e76-a998-0e594395c628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9c739e-4516-4196-bcb4-0585417ee41f', 'volume_name': 'volume-7a9c739e-4516-4196-bcb4-0585417ee41f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f34b155-15f8-4eeb-8f21-2f6e8491741f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f34b155-15f8-4eeb-8f21-2f6e8491741f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4318cc-1db0-4c9d-a84b-a50cd8aea743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Volume 7a9c739e-4516-4196-bcb4-0585417ee41f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9c739e-4516-4196-bcb4-0585417ee41f', 'volume_size': 1} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-209243146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9c739e-4516-4196-bcb4-0585417ee41f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='416cdc19942e4ac3a504145a215b4d8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:37Z,use_quota=True,user_id='f2a33769c61a416f9b90d6309d4bd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Creating volume 7a9c739e-4516-4196-bcb4-0585417ee41f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:37 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:37 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f 1073741824 Sep 07 17:12:37 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:37 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f 1073741824" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:37 devstack sudo[105404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f Sep 07 17:12:37 devstack sudo[105404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:38 devstack sudo[105404]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4318cc-1db0-4c9d-a84b-a50cd8aea743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9c739e-4516-4196-bcb4-0585417ee41f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e03883-7dbe-418e-88c5-cea849c72a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:38 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Volume volume-7a9c739e-4516-4196-bcb4-0585417ee41f (7a9c739e-4516-4196-bcb4-0585417ee41f): created successfully Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e03883-7dbe-418e-88c5-cea849c72a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Flow 'volume_create_manager' (c2ba3722-7a16-4d59-a4f0-4e2cf7177e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-434b7652-28c9-4e44-904b-31f7d29d1064 tempest-ProjectReaderTests-1830746291 None] Created volume successfully. Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "cinder-7a9c739e-4516-4196-bcb4-0585417ee41f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "cinder-7a9c739e-4516-4196-bcb4-0585417ee41f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "cinder-quobyte-7a9c739e-4516-4196-bcb4-0585417ee41f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "cinder-quobyte-7a9c739e-4516-4196-bcb4-0585417ee41f" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3ce9a-3872-4a6b-998e-62f491fd085e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:38 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f Sep 07 17:12:38 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:38 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:38 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f Sep 07 17:12:38 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:39 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7a9c739e-4516-4196-bcb4-0585417ee41f" returned: 0 in 0.231s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "cinder-quobyte-7a9c739e-4516-4196-bcb4-0585417ee41f" released by "delete_volume" :: held 0.605s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Created reservations ['e124fa32-b3ce-42cf-9e8d-0140ecf5d7db', '8d87e3ef-2ea9-497e-9d2f-1a7e7c7686a1', '9e649f52-65df-4992-b92c-12a48f6e22be', 'e9e820ed-3921-422d-add5-f38afee8249c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:39 devstack sudo[105415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:39 devstack sudo[105415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:39 devstack sudo[105415]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.236s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Deleted volume successfully. Sep 07 17:12:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-25042d65-b727-42ac-95f4-cf81811d9921 tempest-ProjectReaderTests-1830746291 None] Lock "cinder-7a9c739e-4516-4196-bcb4-0585417ee41f-delete_volume" released by "delete_volume" :: held 1.019s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (16211966-994f-4fb3-aff1-eedf718e7b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb697b2-3d0c-49d5-b73b-c60ad3894b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afb697b2-3d0c-49d5-b73b-c60ad3894b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867302139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d51092-246d-44d8-9848-540d70e1c933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:47Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447ad3b7-62d4-4cd5-9141-7324a12e4735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (447ad3b7-62d4-4cd5-9141-7324a12e4735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be501e5e-bcdf-4f00-a9fc-406f9dab10bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be501e5e-bcdf-4f00-a9fc-406f9dab10bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d51092-246d-44d8-9848-540d70e1c933', 'volume_name': 'volume-b2d51092-246d-44d8-9848-540d70e1c933', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdabb21-7087-44f2-89ad-abd6a991a548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fdabb21-7087-44f2-89ad-abd6a991a548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea9b14f-2d2e-416d-9e24-8cdd8cf328b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Volume b2d51092-246d-44d8-9848-540d70e1c933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d51092-246d-44d8-9848-540d70e1c933', 'volume_size': 1} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1867302139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d51092-246d-44d8-9848-540d70e1c933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:47Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Creating volume b2d51092-246d-44d8-9848-540d70e1c933 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:46 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:47 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 1073741824 Sep 07 17:12:47 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:47 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 1073741824" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:47 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 Sep 07 17:12:47 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:47 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933" returned: 0 in 0.235s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ea9b14f-2d2e-416d-9e24-8cdd8cf328b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d51092-246d-44d8-9848-540d70e1c933', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721cb694-85b0-4977-8dcf-2abb0382d478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Volume volume-b2d51092-246d-44d8-9848-540d70e1c933 (b2d51092-246d-44d8-9848-540d70e1c933): created successfully Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (721cb694-85b0-4977-8dcf-2abb0382d478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (16211966-994f-4fb3-aff1-eedf718e7b38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a628ed8a-3dec-47e2-ae61-dfad36f45752 tempest-ProjectReaderTests-1683499844 None] Created volume successfully. Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-b2d51092-246d-44d8-9848-540d70e1c933-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-b2d51092-246d-44d8-9848-540d70e1c933-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-quobyte-b2d51092-246d-44d8-9848-540d70e1c933" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-b2d51092-246d-44d8-9848-540d70e1c933" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1036a3-6ec4-4a25-a6c6-0165e36754c2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:48 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 Sep 07 17:12:48 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:48 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:48 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933 Sep 07 17:12:48 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:48 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2d51092-246d-44d8-9848-540d70e1c933" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-b2d51092-246d-44d8-9848-540d70e1c933" released by "delete_volume" :: held 0.620s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Created reservations ['30545bdc-7a02-43ac-835b-02163a8bae7e', '3d02bbc3-3d87-4e56-95be-5da10191053f', '6b4a03e4-9137-4759-b573-84f1659a49ed', 'cdb45932-136d-4a7a-ba71-8bdac81d4c37'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:48 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:48 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:49 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:49 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Deleted volume successfully. Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5a5ec23b-9540-478b-b1e1-4dec07385940 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-b2d51092-246d-44d8-9848-540d70e1c933-delete_volume" released by "delete_volume" :: held 1.038s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (0a64b859-b88b-458d-8ac8-f22881e96ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d705b-3027-4f89-9ca0-ccbee111be23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d705b-3027-4f89-9ca0-ccbee111be23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334970032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dc10a0-dfae-44f8-b222-631f9739c433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:50Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fed87d-741b-49b0-afb6-42219b8c27b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fed87d-741b-49b0-afb6-42219b8c27b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379a4b82-1f0b-41b8-8346-f366471b6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379a4b82-1f0b-41b8-8346-f366471b6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1dc10a0-dfae-44f8-b222-631f9739c433', 'volume_name': 'volume-c1dc10a0-dfae-44f8-b222-631f9739c433', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202a9488-6a03-47e0-ad53-06684ed1c327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (202a9488-6a03-47e0-ad53-06684ed1c327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9957ab56-8525-480a-b91d-75c35f779521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:49 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Volume c1dc10a0-dfae-44f8-b222-631f9739c433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1dc10a0-dfae-44f8-b222-631f9739c433', 'volume_size': 1} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-334970032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1dc10a0-dfae-44f8-b222-631f9739c433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:50Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Creating volume c1dc10a0-dfae-44f8-b222-631f9739c433 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:49 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:49 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 1073741824 Sep 07 17:12:49 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:50 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 1073741824" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:50 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 Sep 07 17:12:50 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:50 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9957ab56-8525-480a-b91d-75c35f779521) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1dc10a0-dfae-44f8-b222-631f9739c433', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf60d3f-37ce-4c5e-af2a-a3b4b42b2c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Volume volume-c1dc10a0-dfae-44f8-b222-631f9739c433 (c1dc10a0-dfae-44f8-b222-631f9739c433): created successfully Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cf60d3f-37ce-4c5e-af2a-a3b4b42b2c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (0a64b859-b88b-458d-8ac8-f22881e96ff7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c6e13e11-bb07-4b00-869b-d11ec8fd2148 tempest-ProjectReaderTests-1683499844 None] Created volume successfully. Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-c1dc10a0-dfae-44f8-b222-631f9739c433-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-c1dc10a0-dfae-44f8-b222-631f9739c433-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-quobyte-c1dc10a0-dfae-44f8-b222-631f9739c433" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-c1dc10a0-dfae-44f8-b222-631f9739c433" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6b8d7e-3f0d-4fe3-91e8-d6dc804920b0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:50 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 Sep 07 17:12:50 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:51 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:51 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433 Sep 07 17:12:51 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:51 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c1dc10a0-dfae-44f8-b222-631f9739c433" returned: 0 in 0.234s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-c1dc10a0-dfae-44f8-b222-631f9739c433" released by "delete_volume" :: held 0.609s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Created reservations ['e78805a6-7aa7-47e2-9406-bdc3f689881f', 'c71f2cce-a2a1-4b26-9520-8a28ddf0032e', '32a1fdbb-71ec-4e02-945a-445b540f3954', '368ec8f7-5ea7-4123-9b0f-13cd4cf6ca11'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:51 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:51 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:51 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.231s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Deleted volume successfully. Sep 07 17:12:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-636e9aaf-8d8d-4415-a8eb-60726d77fb93 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-c1dc10a0-dfae-44f8-b222-631f9739c433-delete_volume" released by "delete_volume" :: held 1.018s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (ed19ffae-03ea-49ea-8295-999685439eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e906b85-7326-42f3-9ccb-5f6442a5e925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e906b85-7326-42f3-9ccb-5f6442a5e925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695339694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d63f6-e5b4-4c1d-afd1-825b4e90dc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:52Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad02b95-9748-40d0-8534-573be1dff510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad02b95-9748-40d0-8534-573be1dff510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9b88e5-4807-4829-8537-6aed0704c965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b9b88e5-4807-4829-8537-6aed0704c965) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '752d63f6-e5b4-4c1d-afd1-825b4e90dc15', 'volume_name': 'volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9f1ce9-6e8e-4fc1-bc2e-933b11bd5d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e9f1ce9-6e8e-4fc1-bc2e-933b11bd5d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e05de84-9133-4602-9e6c-cf2f374fe6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Volume 752d63f6-e5b4-4c1d-afd1-825b4e90dc15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15', 'volume_size': 1} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1695339694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=752d63f6-e5b4-4c1d-afd1-825b4e90dc15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:52Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Creating volume 752d63f6-e5b4-4c1d-afd1-825b4e90dc15 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:52 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 1073741824 Sep 07 17:12:52 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:52 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 1073741824" returned: 0 in 0.424s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:52 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 Sep 07 17:12:52 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:53 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" returned: 0 in 0.234s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e05de84-9133-4602-9e6c-cf2f374fe6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6328b878-4aa0-4404-a279-aa73dc7b7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Volume volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 (752d63f6-e5b4-4c1d-afd1-825b4e90dc15): created successfully Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6328b878-4aa0-4404-a279-aa73dc7b7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (ed19ffae-03ea-49ea-8295-999685439eb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3fd9d392-2dae-4bf2-be30-8fa6ea0b846f tempest-ProjectReaderTests-1683499844 None] Created volume successfully. Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-752d63f6-e5b4-4c1d-afd1-825b4e90dc15-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-752d63f6-e5b4-4c1d-afd1-825b4e90dc15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-quobyte-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e2c400-8605-4571-b24b-e71d44cfa57a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:53 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 Sep 07 17:12:53 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:53 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" returned: 0 in 0.347s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:53 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15 Sep 07 17:12:53 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:53 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-752d63f6-e5b4-4c1d-afd1-825b4e90dc15" released by "delete_volume" :: held 0.622s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Created reservations ['fcad2639-4f96-4973-9cdd-e20c47a82a7c', 'f80af1a7-1593-4c9b-9530-80524f5ca0e4', 'ab3a6c12-6ef8-48bc-bc82-4eff92db1bfc', '0c9cbdca-9684-4420-80f3-f934b93d3937'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:54 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:54 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:54 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.230s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Deleted volume successfully. Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-95ccce22-6725-472f-8fe1-f3478ee11458 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-752d63f6-e5b4-4c1d-afd1-825b4e90dc15-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (a42e0f01-c7d9-49a7-bf9a-8bf7dbab0662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd77f49-d034-49ac-869e-bf475d2f88a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fd77f49-d034-49ac-869e-bf475d2f88a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524747044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b1f56a-6e15-4dc1-b6ef-eb9227869339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:55Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c92f3-6a20-4992-a3df-08eea4fcac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202c92f3-6a20-4992-a3df-08eea4fcac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e9faf7-7e8d-4d98-8c83-74bde1ef9d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81e9faf7-7e8d-4d98-8c83-74bde1ef9d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89b1f56a-6e15-4dc1-b6ef-eb9227869339', 'volume_name': 'volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bd6794-6262-4f22-a296-861fd9078f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bd6794-6262-4f22-a296-861fd9078f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce49e0-c838-475c-8904-ae1480394d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Volume 89b1f56a-6e15-4dc1-b6ef-eb9227869339: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339', 'volume_size': 1} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-524747044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89b1f56a-6e15-4dc1-b6ef-eb9227869339,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11fbb54dfbb94d52be88c77944ac70d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:12:55Z,use_quota=True,user_id='9cc57c616efe4127a56591cf9cef4485',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Creating volume 89b1f56a-6e15-4dc1-b6ef-eb9227869339 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:12:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:12:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:54 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 1073741824 Sep 07 17:12:54 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:55 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 1073741824" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:55 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 Sep 07 17:12:55 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:55 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339" returned: 0 in 0.228s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] <== create_volume: return (653ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.656s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ce49e0-c838-475c-8904-ae1480394d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a86fbb-d4e9-4e41-ae33-001ff56feca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:12:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Volume volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 (89b1f56a-6e15-4dc1-b6ef-eb9227869339): created successfully Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a86fbb-d4e9-4e41-ae33-001ff56feca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Flow 'volume_create_manager' (a42e0f01-c7d9-49a7-bf9a-8bf7dbab0662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:12:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-836fb12f-f18d-4770-bac4-cc870a949b87 tempest-ProjectReaderTests-1683499844 None] Created volume successfully. Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-89b1f56a-6e15-4dc1-b6ef-eb9227869339-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-89b1f56a-6e15-4dc1-b6ef-eb9227869339-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "cinder-quobyte-89b1f56a-6e15-4dc1-b6ef-eb9227869339" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-89b1f56a-6e15-4dc1-b6ef-eb9227869339" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4f0f81-7f61-4167-835a-3d53f3b3557c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:12:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:56 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 Sep 07 17:12:56 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:56 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339" returned: 0 in 0.333s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:56 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339 Sep 07 17:12:56 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:56 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-89b1f56a-6e15-4dc1-b6ef-eb9227869339" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-quobyte-89b1f56a-6e15-4dc1-b6ef-eb9227869339" released by "delete_volume" :: held 0.625s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Created reservations ['bb768139-b067-4a2a-9e5f-f2f8bfe4850e', 'b8f4bbd6-3c9c-4e0a-84e6-2da7af2c7496', 'd21d3d02-1625-486e-a7cc-ee96ef92808c', 'c4990739-070a-463b-af8a-be45ffe07186'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:12:56 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:12:56 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:12:56 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.237s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:12:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Deleted volume successfully. Sep 07 17:12:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7e09d3c4-b9fc-4f9b-b2f6-8af3bc16c238 tempest-ProjectReaderTests-1683499844 None] Lock "cinder-89b1f56a-6e15-4dc1-b6ef-eb9227869339-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:06 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=77,cinder:DELETE=6,cinder:UPDATE=107,cinder:INSERT=30 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:13:06 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=75,cinder:UPDATE=102,cinder:INSERT=28,cinder:DELETE=12 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Flow 'volume_create_manager' (8b6fa58c-e47f-40f5-ab34-d8ec21874f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cffde09-80fe-4e04-9850-4181479541a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cffde09-80fe-4e04-9850-4181479541a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1603601832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc7c0a9-adf6-41a0-a604-5c9c31be2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5904bbed298d4f339c4cc7a44e987af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:09Z,use_quota=True,user_id='4459f88bc60f4d3b94ce786116b69487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dfaf91-8f17-423d-b931-a91044749897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1dfaf91-8f17-423d-b931-a91044749897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1f488-595a-4a9b-ab30-b58706f9adf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36b1f488-595a-4a9b-ab30-b58706f9adf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc7c0a9-adf6-41a0-a604-5c9c31be2b7e', 'volume_name': 'volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c421d1-0c52-4263-b732-d7f711b02fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6c421d1-0c52-4263-b732-d7f711b02fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b3de93-e15a-40c0-b2ca-bb02d4d16dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Volume afc7c0a9-adf6-41a0-a604-5c9c31be2b7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e', 'volume_size': 1} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1603601832',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc7c0a9-adf6-41a0-a604-5c9c31be2b7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5904bbed298d4f339c4cc7a44e987af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:09Z,use_quota=True,user_id='4459f88bc60f4d3b94ce786116b69487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Creating volume afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:08 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e 1073741824 Sep 07 17:13:08 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (12bacefa-4a65-4425-a256-c3fa2ea5eae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f734a22d-16b5-41b1-a162-b54325149bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f734a22d-16b5-41b1-a162-b54325149bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589490033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ff89c-c761-44c8-ac9e-3cee03f71ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:09Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4945a7-2521-4e8b-ba8e-07606bd958b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e4945a7-2521-4e8b-ba8e-07606bd958b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04717d3f-5d87-4f33-af53-78299ebca0cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04717d3f-5d87-4f33-af53-78299ebca0cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '641ff89c-c761-44c8-ac9e-3cee03f71ef8', 'volume_name': 'volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93461e5-bc44-410a-89c6-989d572d2bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b93461e5-bc44-410a-89c6-989d572d2bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50b14e8-8e79-45cc-9dcf-beb0ac108d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume 641ff89c-c761-44c8-ac9e-3cee03f71ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8', 'volume_size': 1} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:09 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e 1073741824" returned: 0 in 0.571s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:09 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:09 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:09 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.711s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1589490033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=641ff89c-c761-44c8-ac9e-3cee03f71ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:09Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume 641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:09 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:09 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 1073741824 Sep 07 17:13:09 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53b3de93-e15a-40c0-b2ca-bb02d4d16dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:09 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062342be-9acb-4933-8999-1288cb3a35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Volume volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e (afc7c0a9-adf6-41a0-a604-5c9c31be2b7e): created successfully Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (062342be-9acb-4933-8999-1288cb3a35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Flow 'volume_create_manager' (8b6fa58c-e47f-40f5-ab34-d8ec21874f99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (cea63367-4bd5-4577-8bd9-fbd777ab12ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5132e9d2-b5e5-4b0f-b885-9d4aea91d05b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-83acabf7-cef8-4fca-a40b-852113053cec tempest-VolumeDependencyTests-1335895922 None] Created volume successfully. Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5132e9d2-b5e5-4b0f-b885-9d4aea91d05b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517975858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e8ab95-4d0e-4953-ac87-72642bdf0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:10Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907b039-9eb8-45e7-a0a5-0187b07388cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8907b039-9eb8-45e7-a0a5-0187b07388cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f96ceb-128b-4504-bf64-05789bf2bc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38f96ceb-128b-4504-bf64-05789bf2bc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3e8ab95-4d0e-4953-ac87-72642bdf0f38', 'volume_name': 'volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e78541b-0d85-4053-9c77-7ee39138fd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e78541b-0d85-4053-9c77-7ee39138fd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952dc17-96f4-4cf8-8276-8ba53f14e434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Volume c3e8ab95-4d0e-4953-ac87-72642bdf0f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38', 'volume_size': 1} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:10 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:13:10 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 1073741824" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:10 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 Sep 07 17:13:10 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:10 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.560s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1517975858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3e8ab95-4d0e-4953-ac87-72642bdf0f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:10Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Creating volume c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:10 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:10 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 1073741824 Sep 07 17:13:10 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e50b14e8-8e79-45cc-9dcf-beb0ac108d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c915bb-5670-4a18-aadb-9322186d3ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 (641ff89c-c761-44c8-ac9e-3cee03f71ef8): created successfully Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c915bb-5670-4a18-aadb-9322186d3ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (12bacefa-4a65-4425-a256-c3fa2ea5eae5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-43bf9f9e-6e1f-4e56-a360-103e25299f77 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:11 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 1073741824" returned: 0 in 0.542s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:11 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 Sep 07 17:13:11 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:11 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.413s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2952dc17-96f4-4cf8-8276-8ba53f14e434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cca977-1ec4-4d46-8eb3-7b4cc4a0e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Creating offline snapshot a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 of volume afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Volume volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 (c3e8ab95-4d0e-4953-ac87-72642bdf0f38): created successfully Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4cca977-1ec4-4d46-8eb3-7b4cc4a0e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (cea63367-4bd5-4577-8bd9-fbd777ab12ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1905b040-42b1-4a24-b87f-3b4e3ce70927]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3e0f04eb-d2e8-4436-b780-c6c0f2f18838 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:13:11 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:11 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:11 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:11 devstack sudo[105615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 1G Sep 07 17:13:11 devstack sudo[105615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:12 devstack sudo[105615]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 1G" returned: 0 in 0.519s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:12 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:12 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:12 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.317s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:12 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 is being set with open permissions: ugo+rw Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:12 devstack sudo[105626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:12 devstack sudo[105626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Flow 'volume_create_manager' (3fd97e0b-2c6f-47a6-af54-3f8f3f56b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca33e23d-7b11-4cb1-a481-ee9366a22202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca33e23d-7b11-4cb1-a481-ee9366a22202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f1e866-da74-4309-9cf0-d714809f5416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c332fe8cb0434296896dbb96ba2a19dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:13Z,use_quota=True,user_id='f1c2e9047ab441dc86079636fb78bb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ed8796-5d52-4a5e-9302-ad5e13cb39df),volume_type_id=a1ed8796-5d52-4a5e-9302-ad5e13cb39df)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ecd47-f15b-4815-a6f5-0ac91efed4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (213ecd47-f15b-4815-a6f5-0ac91efed4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd7d247-901c-426e-929e-82b26910ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:13:12 devstack sudo[105626]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info Sep 07 17:13:13 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cd7d247-901c-426e-929e-82b26910ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c9f1e866-da74-4309-9cf0-d714809f5416', 'volume_name': 'volume-c9f1e866-da74-4309-9cf0-d714809f5416', 'volume_size': 1, 'image_id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c808246777989c72949489e7de588d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c332fe8cb0434296896dbb96ba2a19dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60dfdb5d9e81d598cb002617052339c3d798f2078087066da09a916d2c69e7b690168daabbed8eb1dc6514b7c60730c905d7ca98c2490f40ef79efd46c63da9', 'id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebab964b-3ced-4c7b-8910-9e6be6b67795/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5059c5c4-65a6-4f10-934d-12770eb68d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5059c5c4-65a6-4f10-934d-12770eb68d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775793a8-d4eb-4d05-baac-3bea22754bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:13 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Volume c9f1e866-da74-4309-9cf0-d714809f5416: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c9f1e866-da74-4309-9cf0-d714809f5416', 'volume_size': 1, 'image_id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c808246777989c72949489e7de588d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c332fe8cb0434296896dbb96ba2a19dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60dfdb5d9e81d598cb002617052339c3d798f2078087066da09a916d2c69e7b690168daabbed8eb1dc6514b7c60730c905d7ca98c2490f40ef79efd46c63da9', 'id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebab964b-3ced-4c7b-8910-9e6be6b67795/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Trying to clone c9f1e866-da74-4309-9cf0-d714809f5416 from image ebab964b-3ced-4c7b-8910-9e6be6b67795 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:13:13 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:13 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info is being set with open permissions: ugo+rw Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:13:13 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:13:13 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info Sep 07 17:13:13 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd5b37f-c1d5-4e4e-aef3-6d8e816a4382]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:13 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:13 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.info" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.097s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.250s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating offline snapshot d5393c44-0d4f-415a-8f9b-0aba54d52000 of volume 641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-581cc71e-6996-4324-8475-32795d1cda4b tempest-VolumeDependencyTests-1335895922 None] Create snapshot completed successfully Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e6b16c-1660-4c52-a3c2-4749a6632319]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack sudo[105637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 Sep 07 17:13:13 devstack sudo[105637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:13 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:13 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:13 devstack sudo[105637]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:13 devstack sudo[105646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 1G Sep 07 17:13:13 devstack sudo[105646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:14 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 1 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Temporary image ebab964b-3ced-4c7b-8910-9e6be6b67795 is fetched for user f1c2e9047ab441dc86079636fb78bb39. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b476ac8b-e2ae-4561-9bb5-6c0b3684a07a]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:14 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:14 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:14 devstack sudo[105646]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 1G" returned: 0 in 0.403s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:14 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 Sep 07 17:13:14 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:14 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:14 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:14 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:14 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:14 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 is being set with open permissions: ugo+rw Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:14 devstack sudo[105667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 Sep 07 17:13:14 devstack sudo[105667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Flow 'volume_create_manager' (7bdcf223-bbe5-47a3-8b48-48f2e84b25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe7ca9-04c2-418a-a220-11a0b0b52c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dfe7ca9-04c2-418a-a220-11a0b0b52c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-937490223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409ff869-2e9b-403b-9a70-b8970109aa72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5904bbed298d4f339c4cc7a44e987af0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:15Z,use_quota=True,user_id='4459f88bc60f4d3b94ce786116b69487',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfec53-9a76-4661-a08e-0b67bde256d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbfec53-9a76-4661-a08e-0b67bde256d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8614da-15fb-4061-b2e9-168acd45f95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b8614da-15fb-4061-b2e9-168acd45f95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '409ff869-2e9b-403b-9a70-b8970109aa72', 'volume_name': 'volume-409ff869-2e9b-403b-9a70-b8970109aa72', 'volume_size': 1, 'snapshot_id': 'a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3618b6-a328-4aa4-8399-1fbe9fbcf40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e3618b6-a328-4aa4-8399-1fbe9fbcf40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5f4df-dd41-4bb0-b86f-8eff4beea337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:14 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Volume 409ff869-2e9b-403b-9a70-b8970109aa72: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-409ff869-2e9b-403b-9a70-b8970109aa72', 'volume_size': 1, 'snapshot_id': 'a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8'} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:14 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:14 devstack sudo[105667]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:15 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info Sep 07 17:13:15 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:15 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info" returned: 0 in 0.243s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:15 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info is being set with open permissions: ugo+rw Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:15 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info Sep 07 17:13:15 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:15 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.info" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.161s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot d18f1b88-7c3f-4173-9455-334309c2f137 of volume c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:15 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6762e1fa-4810-4233-a72d-cffeee536b74 tempest-CreateVolumesFromSnapshotTest-670462450 None] Create snapshot completed successfully Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8338f8-72ab-441e-83b7-cab10a548215]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:15 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 Sep 07 17:13:15 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:15 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" returned: 0 in 0.351s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:15 devstack sudo[105684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 1G Sep 07 17:13:15 devstack sudo[105684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:16 devstack sudo[105684]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 1G" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:16 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 Sep 07 17:13:16 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:16 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:16 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 is being set with open permissions: ugo+rw Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:16 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 Sep 07 17:13:16 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:16 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:16 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info Sep 07 17:13:16 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:16 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (cd28a491-233c-485b-86f5-a9fb83c7df7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c3e315-d1e7-4e55-ac7c-6ba68f20a321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83c3e315-d1e7-4e55-ac7c-6ba68f20a321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863813649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f4e04a-ebd0-4e39-806b-c774182aadd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:17Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b987a-ce26-4456-8d8e-88ba3d36063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b11b987a-ce26-4456-8d8e-88ba3d36063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233c8eac-2e07-40d1-baad-7de68e6b5472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233c8eac-2e07-40d1-baad-7de68e6b5472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f4e04a-ebd0-4e39-806b-c774182aadd4', 'volume_name': 'volume-06f4e04a-ebd0-4e39-806b-c774182aadd4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0cb59d-59ed-4f06-a5a2-40d2e4e57257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0cb59d-59ed-4f06-a5a2-40d2e4e57257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe73e2-e998-46c8-868b-3dd8525261ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume 06f4e04a-ebd0-4e39-806b-c774182aadd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f4e04a-ebd0-4e39-806b-c774182aadd4', 'volume_size': 1} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:17 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:17 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info is being set with open permissions: ugo+rw Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:17 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info Sep 07 17:13:17 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:17 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (fcf23e95-fdc3-4767-a90f-f2b861de09d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c5a053-5243-4ed2-a54f-bc99a53eb4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.info" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.549s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-409ff869-2e9b-403b-9a70-b8970109aa72" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3c5a053-5243-4ed2-a54f-bc99a53eb4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1423750181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:17Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703508e5-f791-4bdf-b854-61c1cff766b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703508e5-f791-4bdf-b854-61c1cff766b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b5caf-298c-44f5-9802-66fee231cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a78b5caf-298c-44f5-9802-66fee231cb22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c', 'volume_name': 'volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2b4456-1de2-4a82-9140-b446a843ffea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d2b4456-1de2-4a82-9140-b446a843ffea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4120e6-aba5-446a-9d28-32df10ff1834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c', 'volume_size': 1} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-409ff869-2e9b-403b-9a70-b8970109aa72" acquired by "_create_volume_from_snapshot" :: waited 0.066s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Creating volume 409ff869-2e9b-403b-9a70-b8970109aa72 from snapshot a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:17 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-16ccaa17-a3ca-4dab-94ec-38993673f23f tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] snapshot: a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8, volume: 409ff869-2e9b-403b-9a70-b8970109aa72, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-d18f1b88-7c3f-4173-9455-334309c2f137-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[666c62f3-f303-48be-84da-352fc892c3dc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d18f1b88-7c3f-4173-9455-334309c2f137-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-d18f1b88-7c3f-4173-9455-334309c2f137" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d18f1b88-7c3f-4173-9455-334309c2f137" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot d18f1b88-7c3f-4173-9455-334309c2f137 of volume c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:17 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:17 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (9368db10-fa5c-4318-a207-a3c007036b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58618ff2-52bc-465f-9e99-0fb3622e3ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a5ac27-bdb6-47dc-9de7-f7342aa89c04]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58618ff2-52bc-465f-9e99-0fb3622e3ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397206376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2febe55-36db-4cea-af8e-a08d98b22001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:18Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570f2637-2819-480c-b2de-bd0dbad136cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (570f2637-2819-480c-b2de-bd0dbad136cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b5cfc5-74cc-4779-9b9f-9e66fa9a26b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b5cfc5-74cc-4779-9b9f-9e66fa9a26b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2febe55-36db-4cea-af8e-a08d98b22001', 'volume_name': 'volume-b2febe55-36db-4cea-af8e-a08d98b22001', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3ef28-ece8-4e4e-b7ba-a31cb1551845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5c3ef28-ece8-4e4e-b7ba-a31cb1551845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13d554-a98b-43e5-9017-9d1a75f1d746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume b2febe55-36db-4cea-af8e-a08d98b22001: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2febe55-36db-4cea-af8e-a08d98b22001', 'volume_size': 1} Sep 07 17:13:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:17 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 Sep 07 17:13:17 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:18 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (b8f483de-4953-4795-8bd5-188697307ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a347c980-a59e-4c6a-9a1b-4ba35fbfdc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e844acda-d967-43cb-8a96-cb854373799b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a347c980-a59e-4c6a-9a1b-4ba35fbfdc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989228235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74bbb44-ed19-4898-b85b-6bbdf6245457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:18Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e85215-1a6f-45ec-8969-436d7c04869e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e85215-1a6f-45ec-8969-436d7c04869e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46cfdb9-4bd3-4763-89c3-bd9402a54919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46cfdb9-4bd3-4763-89c3-bd9402a54919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd74bbb44-ed19-4898-b85b-6bbdf6245457', 'volume_name': 'volume-d74bbb44-ed19-4898-b85b-6bbdf6245457', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e66791-4a27-4d0a-ac83-207dcff93760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e66791-4a27-4d0a-ac83-207dcff93760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf564c-9c7e-4dea-90af-04f1490e0c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume d74bbb44-ed19-4898-b85b-6bbdf6245457: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d74bbb44-ed19-4898-b85b-6bbdf6245457', 'volume_size': 1} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:18 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137" returned: 0 in 0.503s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:18 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:18 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f4f58e-1a40-46b2-92a8-0960f7099684]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:18 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 Sep 07 17:13:18 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (904e4c62-b879-4c7f-b983-97f05f4c02c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9ac168-a39c-4f4c-ad3e-b2e6af6480a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c9ac168-a39c-4f4c-ad3e-b2e6af6480a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843576586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:19Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3480b53-27d7-4ffb-a992-11cc64f5cf4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3480b53-27d7-4ffb-a992-11cc64f5cf4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b0a75-15d7-45bb-9a36-cd6f1127c8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574b0a75-15d7-45bb-9a36-cd6f1127c8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844', 'volume_name': 'volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc82854-965f-4008-b4cb-ccc2d4b20402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cc82854-965f-4008-b4cb-ccc2d4b20402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd23b91-9d28-4e1b-ad13-be80cc4675f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:18 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume 3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844', 'volume_size': 1} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:18 devstack sudo[105720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 Sep 07 17:13:18 devstack sudo[105720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:18 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:18 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 Sep 07 17:13:18 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:19 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:19 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137 Sep 07 17:13:19 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:19 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38.d18f1b88-7c3f-4173-9455-334309c2f137" returned: 0 in 0.556s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d18f1b88-7c3f-4173-9455-334309c2f137" released by "_delete_snapshot" :: held 2.116s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" released by "delete_snapshot" :: held 2.156s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:19 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Created reservations ['bda88a0c-f547-49b9-b6f7-8dda616879b6', 'bfb31f09-20c4-455f-b774-6ce1ad756848', 'f014b5e4-b491-4061-926e-b4a16bc06b5a', '394ce5cc-31a7-4a51-8cf3-5a81e4d24f20'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:13:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d0e1371d-7df8-4fa4-8710-b7715eeec934 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d18f1b88-7c3f-4173-9455-334309c2f137-delete_snapshot" released by "delete_snapshot" :: held 2.446s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-c3e8ab95-4d0e-4953-ac87-72642bdf0f38-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c3e8ab95-4d0e-4953-ac87-72642bdf0f38-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" acquired by "delete_volume" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8210afa-b935-4b5b-b1c5-87a0d8b0598a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:21 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 Sep 07 17:13:21 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:22 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" returned: 0 in 1.009s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:22 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38 Sep 07 17:13:22 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:22 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" returned: 0 in 0.647s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3e8ab95-4d0e-4953-ac87-72642bdf0f38" released by "delete_volume" :: held 1.809s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Created reservations ['f37e9b9e-2acf-41cf-9200-feed4db916d1', '935223cf-3476-4978-8899-8fd3b13d9e52', '82ad9c19-429a-4467-ae9e-15b24ed54253', '0d7a4eba-3e5c-4557-9583-4a89cc83aae1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:23 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:23 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:23 devstack sudo[105720]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72" returned: 0 in 4.792s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:13:23 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Converted 1024.00 MB image at 213.63 MB/s Sep 07 17:13:23 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 is being set with open permissions: ugo+rw Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:23 devstack sudo[105755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 Sep 07 17:13:23 devstack sudo[105755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:23 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-0a699f31-adf4-400b-9074-414c0db51e4a tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c3e8ab95-4d0e-4953-ac87-72642bdf0f38-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:23 devstack sudo[105755]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" released by "_copy_volume_from_snapshot" :: held 6.237s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-409ff869-2e9b-403b-9a70-b8970109aa72" released by "_create_volume_from_snapshot" :: held 6.334s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.401s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.940s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9f1e866-da74-4309-9cf0-d714809f5416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c332fe8cb0434296896dbb96ba2a19dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:13Z,use_quota=True,user_id='f1c2e9047ab441dc86079636fb78bb39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a1ed8796-5d52-4a5e-9302-ad5e13cb39df),volume_type_id=a1ed8796-5d52-4a5e-9302-ad5e13cb39df)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Creating volume c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:23 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:23 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1073741824 Sep 07 17:13:23 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7c5f4df-dd41-4bb0-b86f-8eff4beea337) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409ff869-2e9b-403b-9a70-b8970109aa72', 'volume_size': 1, 'snapshot_id': 'a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a8bd7f-744f-49ae-834a-6a288b19af18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:23 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Volume volume-409ff869-2e9b-403b-9a70-b8970109aa72 (409ff869-2e9b-403b-9a70-b8970109aa72): created successfully Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a8bd7f-744f-49ae-834a-6a288b19af18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Flow 'volume_create_manager' (7bdcf223-bbe5-47a3-8b48-48f2e84b25de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8d2af26e-fab9-41c9-8839-33d1d2686fb9 tempest-VolumeDependencyTests-1335895922 None] Created volume successfully. Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (fa5b4685-a24f-4909-9c5d-701e173778a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:23 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001f218-070b-46ee-9654-bbea96ee8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9001f218-070b-46ee-9654-bbea96ee8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689227850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a598934d-6162-459f-b75f-33b59cd83a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:24Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53f53c9-86e2-4e75-b21e-2313edddf07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53f53c9-86e2-4e75-b21e-2313edddf07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a08854-e2cc-488b-a7e2-56e807480ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49a08854-e2cc-488b-a7e2-56e807480ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a598934d-6162-459f-b75f-33b59cd83a3e', 'volume_name': 'volume-a598934d-6162-459f-b75f-33b59cd83a3e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268517cd-45ad-4d0e-be22-260396e4701f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (268517cd-45ad-4d0e-be22-260396e4701f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ad49b6-06c0-48d8-a967-d6f99d6c0316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:24 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Volume a598934d-6162-459f-b75f-33b59cd83a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a598934d-6162-459f-b75f-33b59cd83a3e', 'volume_size': 1} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:24 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1073741824" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:24 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 Sep 07 17:13:24 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:24 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.450s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1863813649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f4e04a-ebd0-4e39-806b-c774182aadd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:17Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume 06f4e04a-ebd0-4e39-806b-c774182aadd4 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:24 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:24 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 1073741824 Sep 07 17:13:24 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Attempting download of ebab964b-3ced-4c7b-8910-9e6be6b67795 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}])) to volume c9f1e866-da74-4309-9cf0-d714809f5416. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddfd43a-cd93-4815-89a4-d3f9883e054c]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Deleting offline snapshot a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 of volume afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] snapshot_file for this snap is: volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8239059-e964-4a6f-bafa-eafd2412133e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:24 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng Sep 07 17:13:24 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:24 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:24 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 1073741824" returned: 0 in 0.505s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 Sep 07 17:13:25 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng Sep 07 17:13:25 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ccc838-9506-40ae-b558-dfbee6e88b53]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:25 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.905s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1423750181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:17Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:25 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng" returned: 1 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebab964b-3ced-4c7b-8910-9e6be6b67795_xg60t3ng' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89fe73e2-e998-46c8-868b-3dd8525261ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f4e04a-ebd0-4e39-806b-c774182aadd4', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:25 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c 1073741824 Sep 07 17:13:25 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d6f0a2-df93-48bd-bb8b-1aa2ef664ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b045a-dfa9-4b85-899a-8c7ad337779d]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 (06f4e04a-ebd0-4e39-806b-c774182aadd4): created successfully Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d6f0a2-df93-48bd-bb8b-1aa2ef664ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (cd28a491-233c-485b-86f5-a9fb83c7df7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6aada2f9-5fe9-4ddb-b7fc-64a9c4049914 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:25 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:25 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:25 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c 1073741824" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:25 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c Sep 07 17:13:25 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:25 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD Sep 07 17:13:25 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD" returned: 1 in 0.334s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] ebab964b-3ced-4c7b-8910-9e6be6b67795 was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:26 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 Sep 07 17:13:26 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" returned: 0 in 0.295s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:26 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8 Sep 07 17:13:26 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.262s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-397206376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2febe55-36db-4cea-af8e-a08d98b22001,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:18Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume b2febe55-36db-4cea-af8e-a08d98b22001 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4120e6-aba5-446a-9d28-32df10ff1834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a81374-b666-4e6b-9a20-6c2169b7c97d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c (b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c): created successfully Sep 07 17:13:26 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 1073741824 Sep 07 17:13:26 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5a81374-b666-4e6b-9a20-6c2169b7c97d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (fcf23e95-fdc3-4767-a90f-f2b861de09d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2ac65764-f154-477a-ae5f-c84fb2a9231f tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:26 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e.a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8" released by "_delete_snapshot" :: held 1.841s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" released by "delete_snapshot" :: held 1.866s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Created reservations ['887aee43-52a5-42de-b2d0-ae649e048880', '41210e3d-ea70-4d38-8970-dd5a8cb7360f', '0ba735bb-9d1d-41d1-8772-d47152eddf45', '87686ff7-339d-4dec-82b1-9d36965264b8'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:26 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416" returned: 0 in 0.517s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebab964b-3ced-4c7b-8910-9e6be6b67795_7t7br42_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:13:26 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:26 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1G Sep 07 17:13:26 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Delete snapshot completed successfully. Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b923398b-63de-49e2-8ed3-bef4b991252c tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-a1f7e4ae-e6d7-4251-96b1-d7c172f6d4c8-delete_snapshot" released by "delete_snapshot" :: held 2.048s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:26 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 1073741824" returned: 0 in 0.521s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:26 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 Sep 07 17:13:26 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5154dcb2-ee38-43b1-ba14-e8eeaf22cac7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 1G" returned: 0 in 0.401s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Downloaded image ebab964b-3ced-4c7b-8910-9e6be6b67795 ((None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}])) to volume c9f1e866-da74-4309-9cf0-d714809f5416 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Temporary image ebab964b-3ced-4c7b-8910-9e6be6b67795 for user f1c2e9047ab441dc86079636fb78bb39 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Marking volume c9f1e866-da74-4309-9cf0-d714809f5416 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:13:27 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:27 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.769s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1989228235',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d74bbb44-ed19-4898-b85b-6bbdf6245457,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:18Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume d74bbb44-ed19-4898-b85b-6bbdf6245457 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Copying metadata from image ebab964b-3ced-4c7b-8910-9e6be6b67795 to c9f1e866-da74-4309-9cf0-d714809f5416. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Creating volume glance metadata for volume c9f1e866-da74-4309-9cf0-d714809f5416 backed by image ebab964b-3ced-4c7b-8910-9e6be6b67795 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c808246777989c72949489e7de588d74', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:13:27 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 1073741824 Sep 07 17:13:27 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a13d554-a98b-43e5-9017-9d1a75f1d746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2febe55-36db-4cea-af8e-a08d98b22001', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c4df65-815e-49a3-84c0-a039834377cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-b2febe55-36db-4cea-af8e-a08d98b22001 (b2febe55-36db-4cea-af8e-a08d98b22001): created successfully Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91c4df65-815e-49a3-84c0-a039834377cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (9368db10-fa5c-4318-a207-a3c007036b96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-614ba75a-d96f-4dc8-8b2d-7be1490f4ae4 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (775793a8-d4eb-4d05-baac-3bea22754bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9f1e866-da74-4309-9cf0-d714809f5416', 'volume_size': 1, 'image_id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebab964b-3ced-4c7b-8910-9e6be6b67795', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c808246777989c72949489e7de588d74', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c332fe8cb0434296896dbb96ba2a19dc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'd60dfdb5d9e81d598cb002617052339c3d798f2078087066da09a916d2c69e7b690168daabbed8eb1dc6514b7c60730c905d7ca98c2490f40ef79efd46c63da9', 'id': 'ebab964b-3ced-4c7b-8910-9e6be6b67795', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebab964b-3ced-4c7b-8910-9e6be6b67795/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac22f86a-06fe-4642-8f35-bbc1122b8835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Volume volume-c9f1e866-da74-4309-9cf0-d714809f5416 (c9f1e866-da74-4309-9cf0-d714809f5416): created successfully Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac22f86a-06fe-4642-8f35-bbc1122b8835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Flow 'volume_create_manager' (3fd97e0b-2c6f-47a6-af54-3f8f3f56b59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-232d2304-b97a-40da-8bd2-6827f6761b6a tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Created volume successfully. Sep 07 17:13:27 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.457s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e Sep 07 17:13:27 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 1073741824" returned: 0 in 0.521s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 Sep 07 17:13:27 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e" released by "delete_volume" :: held 0.803s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Created reservations ['ecb88090-8b1a-4eae-b78d-45d3788a4bfa', '4f40ac39-a109-417a-ad2a-b85b8e6fae62', 'abe1c7d1-2156-4a07-9e92-77317a6b31d2', '072fd105-5783-43c5-804c-cd49c3450d5b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:27 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.217s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1843576586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca6efe7bbee4135be6440fb441cd2bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:19Z,use_quota=True,user_id='ff443f2886b843d0b031140b9679764e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Creating volume 3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:27 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74cf564c-9c7e-4dea-90af-04f1490e0c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d74bbb44-ed19-4898-b85b-6bbdf6245457', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a32ec7-09d0-4fb0-b9ec-54ac4d402b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:27 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 1073741824 Sep 07 17:13:27 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:27 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-409ff869-2e9b-403b-9a70-b8970109aa72-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 (d74bbb44-ed19-4898-b85b-6bbdf6245457): created successfully Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24a32ec7-09d0-4fb0-b9ec-54ac4d402b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (b8f483de-4953-4795-8bd5-188697307ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-409ff869-2e9b-403b-9a70-b8970109aa72-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fec56619-2c94-46c3-aebb-4f17820c86d8 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:28 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Deleted volume successfully. Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-941411c9-32ed-4d5a-91d2-e9d31e4d31bf tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-afc7c0a9-adf6-41a0-a604-5c9c31be2b7e-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4d94c0-fd70-4e41-953a-7da30214cdec]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Acquiring lock "cinder-c9f1e866-da74-4309-9cf0-d714809f5416-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "cinder-c9f1e866-da74-4309-9cf0-d714809f5416-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Acquiring lock "cinder-quobyte-c9f1e866-da74-4309-9cf0-d714809f5416" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "cinder-quobyte-c9f1e866-da74-4309-9cf0-d714809f5416" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[869c4ee6-8180-4407-90da-5e674a2f83bb]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 Sep 07 17:13:28 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 Sep 07 17:13:28 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 1073741824" returned: 0 in 0.589s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack sudo[105873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 Sep 07 17:13:28 devstack sudo[105873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72" returned: 0 in 0.469s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72 Sep 07 17:13:28 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416" returned: 0 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416 Sep 07 17:13:28 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack sudo[105873]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.850s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1689227850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a598934d-6162-459f-b75f-33b59cd83a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:24Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Creating volume a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bd23b91-9d28-4e1b-ad13-be80cc4675f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:28 devstack sudo[105885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e 1073741824 Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f0dec2-23e4-4e48-b1e5-081be1756540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:28 devstack sudo[105885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Volume volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 (3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844): created successfully Sep 07 17:13:28 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29f0dec2-23e4-4e48-b1e5-081be1756540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Flow 'volume_create_manager' (904e4c62-b879-4c7f-b983-97f05f4c02c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-409ff869-2e9b-403b-9a70-b8970109aa72" returned: 0 in 0.305s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-quobyte-409ff869-2e9b-403b-9a70-b8970109aa72" released by "delete_volume" :: held 0.860s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9b2e053d-19af-4a89-a26e-fd52734ca80e tempest-CreateVolumesFromSnapshotTest-670462450 None] Created volume successfully. Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Created reservations ['e02ae230-2677-4142-89ae-4f95708c4c4f', 'f34ff93c-cfa2-4cdd-91bc-dbbd9829fe0f', 'a0fe5da0-36b4-43da-af74-408f32375f84', '512401f6-921c-4e4d-b7db-fca4269d40d9'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:29 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c9f1e866-da74-4309-9cf0-d714809f5416" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "cinder-quobyte-c9f1e866-da74-4309-9cf0-d714809f5416" released by "delete_volume" :: held 0.772s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:29 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:29 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Created reservations ['fac5d67d-a4ab-44db-8147-f68caecd7431', '08997697-210f-4739-b82c-d2ef89412346', 'e46af552-b70f-4a19-8881-85a23603e6f8', '89a267db-eab7-49d4-9364-965923c8c499'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:29 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:29 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:29 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.331s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:29 devstack sudo[105885]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Deleted volume successfully. Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e 1073741824" returned: 0 in 0.587s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37eb2637-05f5-4843-b2e7-bf2ef60640b5 tempest-VolumeDependencyTests-1335895922 None] Lock "cinder-409ff869-2e9b-403b-9a70-b8970109aa72-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:29 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e Sep 07 17:13:29 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:29 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.372s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Deleted volume successfully. Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4005f99a-8611-436e-9176-23a684967be9 tempest-VolumeAndVolumeTypeFromImageTest-1478856629 None] Lock "cinder-c9f1e866-da74-4309-9cf0-d714809f5416-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:29 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e" returned: 0 in 0.304s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3ad49b6-06c0-48d8-a967-d6f99d6c0316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a598934d-6162-459f-b75f-33b59cd83a3e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9be3ffe-c5be-499e-a880-4a54c66ea93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:29 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Volume volume-a598934d-6162-459f-b75f-33b59cd83a3e (a598934d-6162-459f-b75f-33b59cd83a3e): created successfully Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9be3ffe-c5be-499e-a880-4a54c66ea93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (fa5b4685-a24f-4909-9c5d-701e173778a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:29 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ff0f40f7-eee5-405f-9a76-96b9d90221a4 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:13:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[05802f68-33c3-4555-9775-83ec0d750c48]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:30 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 Sep 07 17:13:30 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:30 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" returned: 0 in 0.468s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:30 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844 Sep 07 17:13:30 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot 1871c6f2-25f2-44ee-b69f-e811a2c50983 of volume a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f710643c-dd3b-4397-9de4-2f21d79bb9c6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:30 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:30 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844" released by "delete_volume" :: held 0.862s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:30 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:30 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['e9b44566-fa69-47bc-9ef1-d6546e89a33b', 'a5fe2ae6-927f-4083-8880-9e75d763b110', 'bc8ce747-cd9a-484e-bdbd-2054bba93fe1', 'af058001-c03a-4021-9a0d-b9a100d5205f'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:31 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:31 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-d74bbb44-ed19-4898-b85b-6bbdf6245457-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:31 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-d74bbb44-ed19-4898-b85b-6bbdf6245457-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:31 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 1G Sep 07 17:13:31 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-d74bbb44-ed19-4898-b85b-6bbdf6245457" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-d74bbb44-ed19-4898-b85b-6bbdf6245457" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa1b0f-1c94-44ef-be1d-660134e32868]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:31 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.447s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:31 devstack sudo[105919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 Sep 07 17:13:31 devstack sudo[105919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8dd1c83b-a523-4472-b5f9-32964cb1a5cb tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-3d6c42c4-efc1-4cf8-b5c8-0ae6eec99844-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:31 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 1G" returned: 0 in 0.580s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a598934d-6162-459f-b75f-33b59cd83a3e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:31 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a598934d-6162-459f-b75f-33b59cd83a3e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 Sep 07 17:13:31 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:31 devstack sudo[105919]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:31 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457 Sep 07 17:13:31 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:32 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a598934d-6162-459f-b75f-33b59cd83a3e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:32 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 is being set with open permissions: ugo+rw Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:32 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d74bbb44-ed19-4898-b85b-6bbdf6245457" returned: 0 in 0.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:32 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 Sep 07 17:13:32 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-d74bbb44-ed19-4898-b85b-6bbdf6245457" released by "delete_volume" :: held 0.876s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['9f7fe040-4630-488b-83f0-288a2e7173f7', '14ef4b03-502c-4998-ac5a-0129a9b752b5', 'eac5b7d1-e072-467d-9030-cc7de6729a18', '9f61c5ec-617f-49d6-b142-5752f13dcc66'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:32 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:32 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-b2febe55-36db-4cea-af8e-a08d98b22001-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-b2febe55-36db-4cea-af8e-a08d98b22001-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:32 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-b2febe55-36db-4cea-af8e-a08d98b22001" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983" returned: 0 in 0.427s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-b2febe55-36db-4cea-af8e-a08d98b22001" acquired by "delete_volume" :: waited 0.037s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[977bb4fa-11b8-4122-b35d-6c92379efc11]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:32 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info Sep 07 17:13:32 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:32 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:32 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-210a0cdf-d25b-448d-aa59-531a1dcfd429 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-d74bbb44-ed19-4898-b85b-6bbdf6245457-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:32 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 Sep 07 17:13:32 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:33 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info" returned: 0 in 0.354s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info is being set with open permissions: ugo+rw Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:33 devstack sudo[105948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info Sep 07 17:13:33 devstack sudo[105948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:33 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:33 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001 Sep 07 17:13:33 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:33 devstack sudo[105948]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.info" returned: 0 in 0.302s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.672s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-6e0c4baf-8fda-4d90-841e-a10ba022ea41 tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:13:33 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b2febe55-36db-4cea-af8e-a08d98b22001" returned: 0 in 0.294s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-b2febe55-36db-4cea-af8e-a08d98b22001" released by "delete_volume" :: held 0.873s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['5f92536f-dcfd-40e5-a380-afac8cd9cb09', '62c530c7-3f84-4dd2-9a5d-768bae172ed2', 'e6ada416-7269-416f-8033-ab3944294508', 'f8d0edd5-129e-4f6b-9751-d7f25ea7a5f0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:33 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:33 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-1871c6f2-25f2-44ee-b69f-e811a2c50983-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[813b2ab7-24a4-4c5f-8ffb-002e5bd47ed0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-1871c6f2-25f2-44ee-b69f-e811a2c50983-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-1871c6f2-25f2-44ee-b69f-e811a2c50983" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:34 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1871c6f2-25f2-44ee-b69f-e811a2c50983" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot 1871c6f2-25f2-44ee-b69f-e811a2c50983 of volume a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[859097eb-180a-4ea7-9154-f0662ce01bd0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:34 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c Sep 07 17:13:34 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4d11adc8-c053-41d1-90a5-9b46d3ca097f tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-b2febe55-36db-4cea-af8e-a08d98b22001-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:34 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 Sep 07 17:13:34 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:34 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" returned: 0 in 0.491s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:34 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c Sep 07 17:13:34 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:34 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a598934d-6162-459f-b75f-33b59cd83a3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[92127476-8b72-4ff5-9136-952b537a0523]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:34 devstack sudo[105975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e Sep 07 17:13:34 devstack sudo[105975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:34 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" returned: 0 in 0.309s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c" released by "delete_volume" :: held 0.884s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['847a715d-8dfb-4c2d-8799-b0a499c393f0', '8dab99ab-851f-43e8-bfea-911187427d80', '30177c48-7d75-4ba2-a50d-5a0a63426c51', '83381b6f-eed6-422e-8af8-381e473b7983'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:34 devstack sudo[105975]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:35 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:35 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:35 devstack sudo[105982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 Sep 07 17:13:35 devstack sudo[105982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:35 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (126a8a27-d924-40dc-b769-8d924e8be538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820aa1de-c820-4ccd-9dfc-8b51275e7c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (820aa1de-c820-4ccd-9dfc-8b51275e7c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647374474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8451e96d-2072-45a8-9e74-79c8bc31e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:35Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ad021a-b5f4-4126-b1ec-ffb6d4642682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43ad021a-b5f4-4126-b1ec-ffb6d4642682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb38c22-5397-45c3-b35c-b562dba517e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acb38c22-5397-45c3-b35c-b562dba517e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8451e96d-2072-45a8-9e74-79c8bc31e062', 'volume_name': 'volume-8451e96d-2072-45a8-9e74-79c8bc31e062', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4709d970-f41a-42c0-8640-64e732da162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4709d970-f41a-42c0-8640-64e732da162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad76b034-789c-4f0f-8be7-2b928dd60d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Volume 8451e96d-2072-45a8-9e74-79c8bc31e062: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8451e96d-2072-45a8-9e74-79c8bc31e062', 'volume_size': 1} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-647374474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8451e96d-2072-45a8-9e74-79c8bc31e062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:35Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Creating volume 8451e96d-2072-45a8-9e74-79c8bc31e062 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:35 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:35 devstack sudo[105982]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983" returned: 0 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-d75e44e3-cd52-4fcc-b8bf-258b2e951046 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-b89b132a-dd6a-40d4-a7d0-fbe6b9f1d28c-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:35 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 1073741824 Sep 07 17:13:35 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:35 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983 Sep 07 17:13:35 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (4e0173d4-a288-46c9-8173-7753eb7dbbce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:35 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535a7702-47ef-49b5-b163-f116d22dd5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e.1871c6f2-25f2-44ee-b69f-e811a2c50983" returned: 0 in 0.337s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (535a7702-47ef-49b5-b163-f116d22dd5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534063043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f1282d-3730-4ee9-8957-af556a2e8061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:36Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a98ab7-3e74-4930-aa6c-f5fa5fec60d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a98ab7-3e74-4930-aa6c-f5fa5fec60d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5fb73-4a62-4096-8cc1-eeda5fe2fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd5fb73-4a62-4096-8cc1-eeda5fe2fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86f1282d-3730-4ee9-8957-af556a2e8061', 'volume_name': 'volume-86f1282d-3730-4ee9-8957-af556a2e8061', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f521eb-a184-4a60-8d3c-fbff2c3f7776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f521eb-a184-4a60-8d3c-fbff2c3f7776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8606b9-bf71-40a2-b2a7-be26e6a96c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Volume 86f1282d-3730-4ee9-8957-af556a2e8061: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86f1282d-3730-4ee9-8957-af556a2e8061', 'volume_size': 1} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1871c6f2-25f2-44ee-b69f-e811a2c50983" released by "_delete_snapshot" :: held 1.947s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" released by "delete_snapshot" :: held 1.989s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Created reservations ['c083ec67-c781-4617-aafa-f3c413892e1b', '4a537e3a-5d97-4b65-89a0-76df3454bb7d', 'e5fc8a88-e731-4704-9911-4ba83b448bb1', '8a476bd5-bb44-457b-a4e7-8c951b1410c2'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-eef98fcb-585c-4089-8084-5674b27934c7 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-1871c6f2-25f2-44ee-b69f-e811a2c50983-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:36 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 1073741824" returned: 0 in 0.701s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (e80692f7-73f5-466b-91c0-841bec44923e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d53a25f-62b8-4369-be40-989edcbcda4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d53a25f-62b8-4369-be40-989edcbcda4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104032840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec5922d-75c8-4937-be76-c3b7e32c9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:36Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a18be42-7ec1-4b62-90b2-9b8fbace1488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 Sep 07 17:13:36 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a18be42-7ec1-4b62-90b2-9b8fbace1488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1174e23-bdc2-4fb4-9a02-e2a8f44c0ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1174e23-bdc2-4fb4-9a02-e2a8f44c0ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ec5922d-75c8-4937-be76-c3b7e32c9ba6', 'volume_name': 'volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ce17be-7e87-49e0-947c-98a7dc464b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31ce17be-7e87-49e0-947c-98a7dc464b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a00a5-aa36-41fb-8542-b9f344827f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Volume 3ec5922d-75c8-4937-be76-c3b7e32c9ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6', 'volume_size': 1} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-06f4e04a-ebd0-4e39-806b-c774182aadd4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-06f4e04a-ebd0-4e39-806b-c774182aadd4-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-06f4e04a-ebd0-4e39-806b-c774182aadd4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-06f4e04a-ebd0-4e39-806b-c774182aadd4" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:36 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.757s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1534063043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86f1282d-3730-4ee9-8957-af556a2e8061,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:36Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Creating volume 86f1282d-3730-4ee9-8957-af556a2e8061 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:36 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c797e19-9c46-4d4b-82aa-fe80a4e6f7b5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:36 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 1073741824 Sep 07 17:13:36 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad76b034-789c-4f0f-8be7-2b928dd60d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8451e96d-2072-45a8-9e74-79c8bc31e062', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e6a5df-c5f7-4912-a3e3-d00a2e4350db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (868cf4e6-6281-49e5-a59e-d779e237da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee95b0bf-ed6c-4e4a-acea-a9d36f7f11db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Volume volume-8451e96d-2072-45a8-9e74-79c8bc31e062 (8451e96d-2072-45a8-9e74-79c8bc31e062): created successfully Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6e6a5df-c5f7-4912-a3e3-d00a2e4350db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (126a8a27-d924-40dc-b769-8d924e8be538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee95b0bf-ed6c-4e4a-acea-a9d36f7f11db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977254429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cd277e-6792-4956-aa57-6a05f255efa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba726f59-95d2-4018-8b9a-887f75ed8e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba726f59-95d2-4018-8b9a-887f75ed8e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6d51b-783d-41a4-a537-67f4cd5667b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32a6d51b-783d-41a4-a537-67f4cd5667b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96cd277e-6792-4956-aa57-6a05f255efa9', 'volume_name': 'volume-96cd277e-6792-4956-aa57-6a05f255efa9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61094fd0-89e5-4726-b0f3-d1fb1ab4d39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61094fd0-89e5-4726-b0f3-d1fb1ab4d39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 Sep 07 17:13:37 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ed3767-8d5c-49df-823f-e3dc63893236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Volume 96cd277e-6792-4956-aa57-6a05f255efa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96cd277e-6792-4956-aa57-6a05f255efa9', 'volume_size': 1} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7e2a8b20-9b69-48e4-b203-bd87be0a94a8 tempest-CreateVolumesFromImageTest-864349796 None] Created volume successfully. Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Flow 'volume_create_manager' (726b7cf9-2884-4b35-b0da-42c07d21c39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba8b58-2922-4b6b-93a7-bd3accb543b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-a598934d-6162-459f-b75f-33b59cd83a3e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12ba8b58-2922-4b6b-93a7-bd3accb543b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c48aa00-bcc1-47e4-8394-c1d80c2302c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9793e73438b84371bf3976eaac3fddf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='9bbb97f1a34b4668a5d967f24f6cbb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25c3ba9-b54d-427b-822a-09dbb271757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d25c3ba9-b54d-427b-822a-09dbb271757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bb9527-473b-43d5-8300-6e151484a3df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.image.glance [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Creating Keystone auth plugin from conf {{(pid=86783) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-a598934d-6162-459f-b75f-33b59cd83a3e-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" acquired by "delete_volume" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c3982-37b5-4629-bf41-3cce72fe1642]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:37 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4" returned: 0 in 0.676s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (6e61e10f-e634-4214-bf8d-3cbab159795d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:37 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4 Sep 07 17:13:37 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72ec175-a19e-4e07-bd98-4f3e704fe6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b72ec175-a19e-4e07-bd98-4f3e704fe6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-952682578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2ae4df-1106-4038-94b4-25c702081f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9721bc9d-cbdf-4370-a3fc-0a214b10309a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9721bc9d-cbdf-4370-a3fc-0a214b10309a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a5aa41-6f73-4c42-b81e-fe584513e240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62a5aa41-6f73-4c42-b81e-fe584513e240) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db2ae4df-1106-4038-94b4-25c702081f9f', 'volume_name': 'volume-db2ae4df-1106-4038-94b4-25c702081f9f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6446c135-59a6-445a-a254-408f3ed094f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6446c135-59a6-445a-a254-408f3ed094f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418c7f71-e477-46a0-ae9d-fa0aa96c032b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Volume db2ae4df-1106-4038-94b4-25c702081f9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db2ae4df-1106-4038-94b4-25c702081f9f', 'volume_size': 1} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:37 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e Sep 07 17:13:37 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:37 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 1073741824" returned: 0 in 0.829s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:37 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 Sep 07 17:13:37 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8bb9527-473b-43d5-8300-6e151484a3df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6c48aa00-bcc1-47e4-8394-c1d80c2302c7', 'volume_name': 'volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7', 'volume_size': 1, 'image_id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04cd29ced8c62f504d5ee833e0becdd9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9793e73438b84371bf3976eaac3fddf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d37667361fb7b94d41593a5a31e0d6518f49b86463161afa739eb40f580429d237ce285a14f99a1b80833e14b63577e2c8c00946bcfb05faa8252b26512d316', 'id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eae96f84-317e-460f-9986-dbe9fb0bf10a/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029a16f-6b37-4e7d-a7f7-f2e5d8088034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a029a16f-6b37-4e7d-a7f7-f2e5d8088034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea947bd-239d-416f-bfcf-426b55430e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:37 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7', 'volume_size': 1, 'image_id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04cd29ced8c62f504d5ee833e0becdd9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9793e73438b84371bf3976eaac3fddf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d37667361fb7b94d41593a5a31e0d6518f49b86463161afa739eb40f580429d237ce285a14f99a1b80833e14b63577e2c8c00946bcfb05faa8252b26512d316', 'id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eae96f84-317e-460f-9986-dbe9fb0bf10a/file', 'properties': {}}, 'image_service': } Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Trying to clone 6c48aa00-bcc1-47e4-8394-c1d80c2302c7 from image eae96f84-317e-460f-9986-dbe9fb0bf10a at location (None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}]). {{(pid=86783) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 17:13:37 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-06f4e04a-ebd0-4e39-806b-c774182aadd4" returned: 0 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-06f4e04a-ebd0-4e39-806b-c774182aadd4" released by "delete_volume" :: held 1.144s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['945ebf40-1af5-48b2-a4f7-7bbd7e175da1', '2ae9dfd6-1b52-4d3c-9695-8369ee437730', '854e632f-e856-4615-aaa6-75d135138bc2', '2f6b4998-11cf-4f2e-856a-14a720ae5204'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:37 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 17:13:37 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Image download 0.00 MB at 0.00 MB/s Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e" returned: 0 in 0.526s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:37 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e Sep 07 17:13:37 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:37 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef5d8d-04f2-4e1e-aae8-67cd15e499bb]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061" returned: 0 in 0.405s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.295s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.615s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-104032840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ec5922d-75c8-4937-be76-c3b7e32c9ba6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:36Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Creating volume 3ec5922d-75c8-4937-be76-c3b7e32c9ba6 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f8606b9-bf71-40a2-b2a7-be26e6a96c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86f1282d-3730-4ee9-8957-af556a2e8061', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f794ff89-c6cf-4503-8254-9b7adbae4f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:38 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 1073741824 Sep 07 17:13:38 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Volume volume-86f1282d-3730-4ee9-8957-af556a2e8061 (86f1282d-3730-4ee9-8957-af556a2e8061): created successfully Sep 07 17:13:38 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:38 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f794ff89-c6cf-4503-8254-9b7adbae4f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (4e0173d4-a288-46c9-8173-7753eb7dbbce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:38 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:38 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-95587755-e436-44d4-a9c8-d0feb3f61229 tempest-CreateVolumesFromImageTest-864349796 None] Created volume successfully. Sep 07 17:13:38 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a598934d-6162-459f-b75f-33b59cd83a3e" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a598934d-6162-459f-b75f-33b59cd83a3e" released by "delete_volume" :: held 0.957s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Created reservations ['d43d98b8-f534-4ebc-9a61-712dee6d9ee1', 'bd208d08-6a4f-466b-895a-ff196074ac27', '3ba558e0-efa2-4626-b948-cf064d2ea2a5', 'bb7ace0c-6819-427b-8944-01fa54e13ef7'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:38 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.318s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:38 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 0 in 0.502s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5aefb906-e1af-4009-8d88-169c57cf8d35 tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-06f4e04a-ebd0-4e39-806b-c774182aadd4-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:38 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:38 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:38 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 1073741824" returned: 0 in 0.626s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 Sep 07 17:13:38 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-1c9de5e2-3103-4ab3-8e7b-cbaf309837a4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-a598934d-6162-459f-b75f-33b59cd83a3e-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:38 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 1 in 0.367s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Temporary image eae96f84-317e-460f-9986-dbe9fb0bf10a is fetched for user 9bbb97f1a34b4668a5d967f24f6cbb59. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eb7e7f-e385-4beb-a5de-2d55e6144842]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.934s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-977254429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96cd277e-6792-4956-aa57-6a05f255efa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Creating volume 96cd277e-6792-4956-aa57-6a05f255efa9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:38 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c4a00a5-aa36-41fb-8542-b9f344827f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:38 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 1073741824 Sep 07 17:13:38 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:38 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f552be43-3d59-4c65-b0b4-ba6afa3bc08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:39 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Volume volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 (3ec5922d-75c8-4937-be76-c3b7e32c9ba6): created successfully Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f552be43-3d59-4c65-b0b4-ba6afa3bc08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (e80692f7-73f5-466b-91c0-841bec44923e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:39 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:39 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-73ca55a1-8b13-4ca4-b568-4ef6de3a3d94 tempest-CreateVolumesFromImageTest-864349796 None] Created volume successfully. Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-d5393c44-0d4f-415a-8f9b-0aba54d52000-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-d5393c44-0d4f-415a-8f9b-0aba54d52000-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-d5393c44-0d4f-415a-8f9b-0aba54d52000" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-d5393c44-0d4f-415a-8f9b-0aba54d52000" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleting offline snapshot d5393c44-0d4f-415a-8f9b-0aba54d52000 of volume 641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] snapshot_file for this snap is: volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[512acb24-4d67-4418-81e1-e126b1cc412e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:39 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:39 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 Sep 07 17:13:39 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 1073741824" returned: 0 in 0.464s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:39 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:39 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:39 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 Sep 07 17:13:39 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000" returned: 0 in 0.481s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3996285-123f-4350-82ab-4eedf8930ee9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:39 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 1 in 0.450s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:39 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.870s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.308s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-952682578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db2ae4df-1106-4038-94b4-25c702081f9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79b39552bed14ae3aef3962387c1a286',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='304677ad6b9b415585f65edfb8754d3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Creating volume db2ae4df-1106-4038-94b4-25c702081f9f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:39 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:39 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f 1073741824 Sep 07 17:13:39 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67ed3767-8d5c-49df-823f-e3dc63893236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96cd277e-6792-4956-aa57-6a05f255efa9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2e464e-ae2d-44f0-a3ae-fa89dad4d06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:39 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 Sep 07 17:13:39 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:39 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Volume volume-96cd277e-6792-4956-aa57-6a05f255efa9 (96cd277e-6792-4956-aa57-6a05f255efa9): created successfully Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2e464e-ae2d-44f0-a3ae-fa89dad4d06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (868cf4e6-6281-49e5-a59e-d779e237da66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fbe03912-9e11-4a9c-aafa-6507f5d3b554 tempest-CreateVolumesFromImageTest-864349796 None] Created volume successfully. Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (46b57dbe-f3a5-4cd0-9d1a-fb391754d369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:39 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb10a1a2-20e7-4dc1-a0d6-3c7fb9d6bf6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb10a1a2-20e7-4dc1-a0d6-3c7fb9d6bf6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512040478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c24dc9-39c6-41f3-85f0-d21ab2134e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:40Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace08081-91ea-4937-a969-965e19b3ec8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace08081-91ea-4937-a969-965e19b3ec8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae58f05-85f5-4b42-832c-b5ab2440f2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dae58f05-85f5-4b42-832c-b5ab2440f2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c24dc9-39c6-41f3-85f0-d21ab2134e6f', 'volume_name': 'volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f1511d-177a-484d-93b6-b9945dc8b7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5f1511d-177a-484d-93b6-b9945dc8b7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeacc8f-1c0e-4cd7-b788-bec36a53911d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Volume c3c24dc9-39c6-41f3-85f0-d21ab2134e6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f', 'volume_size': 1} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:40 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8" returned: 0 in 0.420s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:40 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 Sep 07 17:13:40 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:40 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f 1073741824" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:40 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f Sep 07 17:13:40 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:40 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000" returned: 0 in 0.339s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:40 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000 Sep 07 17:13:40 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:40 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c48aa00-bcc1-47e4-8394-c1d80c2302c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9793e73438b84371bf3976eaac3fddf6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:37Z,use_quota=True,user_id='9bbb97f1a34b4668a5d967f24f6cbb59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Creating volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:40 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1073741824 Sep 07 17:13:40 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (418c7f71-e477-46a0-ae9d-fa0aa96c032b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db2ae4df-1106-4038-94b4-25c702081f9f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7a4a79-023f-4f86-bd67-2ce40741996a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Volume volume-db2ae4df-1106-4038-94b4-25c702081f9f (db2ae4df-1106-4038-94b4-25c702081f9f): created successfully Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7a4a79-023f-4f86-bd67-2ce40741996a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Flow 'volume_create_manager' (6e61e10f-e634-4214-bf8d-3cbab159795d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-dffeaf5a-108a-413d-bba4-7335835ed06b tempest-CreateVolumesFromImageTest-864349796 None] Created volume successfully. Sep 07 17:13:40 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8.d5393c44-0d4f-415a-8f9b-0aba54d52000" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-d5393c44-0d4f-415a-8f9b-0aba54d52000" released by "_delete_snapshot" :: held 1.677s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" released by "delete_snapshot" :: held 1.709s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['d45e324e-ed52-4902-93b8-c99dc223be88', '56429646-9117-4018-a9b5-20a3f59cf053', '3d5f48ae-8e65-44ba-8692-8faa0e54c113', 'ab4e21f5-243e-4855-9103-6b473126a82c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Delete snapshot completed successfully. Sep 07 17:13:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-29961855-4563-40cc-bf27-b90b1177fb6c tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-d5393c44-0d4f-415a-8f9b-0aba54d52000-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-db2ae4df-1106-4038-94b4-25c702081f9f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-db2ae4df-1106-4038-94b4-25c702081f9f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-quobyte-db2ae4df-1106-4038-94b4-25c702081f9f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-db2ae4df-1106-4038-94b4-25c702081f9f" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd44c0d-617a-44ba-9cc0-3d7998395175]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1073741824" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 Sep 07 17:13:41 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f Sep 07 17:13:41 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-641ff89c-c761-44c8-ac9e-3cee03f71ef8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-641ff89c-c761-44c8-ac9e-3cee03f71ef8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4770c081-39a9-4a15-ad0f-8ea4cf68f2cf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.440s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512040478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c24dc9-39c6-41f3-85f0-d21ab2134e6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:40Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Creating volume c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:41 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 Sep 07 17:13:41 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f 1073741824 Sep 07 17:13:41 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Attempting download of eae96f84-317e-460f-9986-dbe9fb0bf10a ((None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}])) to volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 17:13:41 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f Sep 07 17:13:41 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e326261f-483c-4021-b4e7-1da7b16cc4b1]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp Sep 07 17:13:41 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:41 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8 Sep 07 17:13:41 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:41 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db2ae4df-1106-4038-94b4-25c702081f9f" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-db2ae4df-1106-4038-94b4-25c702081f9f" released by "delete_volume" :: held 0.899s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:42 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Created reservations ['95d19004-9433-4cb1-b327-11372ff17317', '37ba64ff-47dc-4394-9e98-e657461905f4', '1f4c66ee-3031-490b-8497-98f6943d22f1', '6662507e-b54c-4b75-b587-81eb7f4f5c41'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f 1073741824" returned: 0 in 0.577s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f Sep 07 17:13:42 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp Sep 07 17:13:42 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-96cd277e-6792-4956-aa57-6a05f255efa9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:42 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-96cd277e-6792-4956-aa57-6a05f255efa9-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:42 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-641ff89c-c761-44c8-ac9e-3cee03f71ef8" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-quobyte-96cd277e-6792-4956-aa57-6a05f255efa9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-quobyte-641ff89c-c761-44c8-ac9e-3cee03f71ef8" released by "delete_volume" :: held 1.070s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-96cd277e-6792-4956-aa57-6a05f255efa9" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c589b02-eb72-4615-9d70-a54058d51cc2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:42 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eeacc8f-1c0e-4cd7-b788-bec36a53911d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab70386-f293-46a0-b863-6808d42979bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp" returned: 1 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eae96f84-317e-460f-9986-dbe9fb0bf10a_r0bkmfwp' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[267f8e3f-84a8-4c34-b1ec-0a5a0ae12b1a]: (4, 'raw') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Created reservations ['05a42042-43f6-4feb-be37-488c1a16755e', '3da3eb69-82fc-466d-8f38-4198b13c605a', 'f58dbb65-6ff2-401a-a3c5-6738eccdc5de', '6ac88ba5-0f0a-4c4d-9dcd-da6f0d62fe78'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:42 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Volume volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f (c3c24dc9-39c6-41f3-85f0-d21ab2134e6f): created successfully Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ab70386-f293-46a0-b863-6808d42979bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (46b57dbe-f3a5-4cd0-9d1a-fb391754d369) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:42 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 Sep 07 17:13:42 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Deleted volume successfully. Sep 07 17:13:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc039d4f-7b25-4830-9e2b-55b65858afb0 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c6074f-3986-48c7-afa4-e2c0e897504f tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-db2ae4df-1106-4038-94b4-25c702081f9f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:42 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:42 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:42 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9" returned: 0 in 0.412s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:42 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9 Sep 07 17:13:42 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:42 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Deleted volume successfully. Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-be3608ad-c467-4d16-b689-7f8c445591da tempest-CreateVolumesFromSnapshotTest-670462450 None] Lock "cinder-641ff89c-c761-44c8-ac9e-3cee03f71ef8-delete_volume" released by "delete_volume" :: held 1.821s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:43 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD Sep 07 17:13:43 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-96cd277e-6792-4956-aa57-6a05f255efa9" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-96cd277e-6792-4956-aa57-6a05f255efa9" released by "delete_volume" :: held 0.776s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Created reservations ['9e83bd64-b6b7-49a2-b6e4-047c583cc15d', '8d1d628b-c0f3-4c02-a57c-7a16debb79c8', 'af413a63-5592-4121-a548-c85b416b2fc3', '110058b6-9fe9-4e0a-970c-c6ab07660d90'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot d50282bd-c9af-4d0e-a107-2aee01bdfcd4 of volume c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7246a089-5d2d-4f96-acf0-b81252ab938e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:43 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD' failed. Not Retrying. {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] eae96f84-317e-460f-9986-dbe9fb0bf10a was raw, converting to qcow2 {{(pid=86783) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 Sep 07 17:13:43 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-3ec5922d-75c8-4937-be76-c3b7e32c9ba6-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-3ec5922d-75c8-4937-be76-c3b7e32c9ba6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:43 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:43 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-quobyte-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:43 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[931355b9-4ea3-43f4-b93d-bf145d13be25]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" returned: 0 in 0.513s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:43 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 Sep 07 17:13:43 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:43 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 1G Sep 07 17:13:43 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Deleted volume successfully. Sep 07 17:13:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-fa43124f-9744-4fe0-8a32-92c70b2ebb79 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-96cd277e-6792-4956-aa57-6a05f255efa9-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:44 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" returned: 0 in 0.845s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eae96f84-317e-460f-9986-dbe9fb0bf10a_vud0mli2devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:13:44 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:44 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1G Sep 07 17:13:44 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:44 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6 Sep 07 17:13:44 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:44 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 1G" returned: 0 in 0.630s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:44 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 Sep 07 17:13:44 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:44 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-3ec5922d-75c8-4937-be76-c3b7e32c9ba6" released by "delete_volume" :: held 0.913s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:44 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 1G" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Downloaded image eae96f84-317e-460f-9986-dbe9fb0bf10a ((None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}])) to volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7 successfully. {{(pid=86783) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Temporary image eae96f84-317e-460f-9986-dbe9fb0bf10a for user 9bbb97f1a34b4668a5d967f24f6cbb59 is deleted. {{(pid=86783) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.volume_utils [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Marking volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7 as bootable. {{(pid=86783) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Copying metadata from image eae96f84-317e-460f-9986-dbe9fb0bf10a to 6c48aa00-bcc1-47e4-8394-c1d80c2302c7. {{(pid=86783) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Creating volume glance metadata for volume 6c48aa00-bcc1-47e4-8394-c1d80c2302c7 backed by image eae96f84-317e-460f-9986-dbe9fb0bf10a with: {'image_id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '04cd29ced8c62f504d5ee833e0becdd9', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86783) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Created reservations ['72625a7d-4ebf-467b-a522-0c0be52ede1c', 'e01092ae-70d0-4ba1-8127-06d7d1862c2e', '69fc9904-81db-4c78-8c04-0c3e93a446cb', 'b48ee2f6-e30d-459e-834e-1829bdf3a2da'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea947bd-239d-416f-bfcf-426b55430e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7', 'volume_size': 1, 'image_id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eae96f84-317e-460f-9986-dbe9fb0bf10a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '04cd29ced8c62f504d5ee833e0becdd9', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '9793e73438b84371bf3976eaac3fddf6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '3d37667361fb7b94d41593a5a31e0d6518f49b86463161afa739eb40f580429d237ce285a14f99a1b80833e14b63577e2c8c00946bcfb05faa8252b26512d316', 'id': 'eae96f84-317e-460f-9986-dbe9fb0bf10a', 'created_at': datetime.datetime(2026, 9, 7, 15, 13, 34, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 15, 13, 35, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eae96f84-317e-460f-9986-dbe9fb0bf10a/file', 'properties': {}}, 'image_service': }' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff6f897-069e-4dbb-88d3-2e84a9132a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:44 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:44 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:44 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Volume volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 (6c48aa00-bcc1-47e4-8394-c1d80c2302c7): created successfully Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ff6f897-069e-4dbb-88d3-2e84a9132a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Flow 'volume_create_manager' (726b7cf9-2884-4b35-b0da-42c07d21c39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0916710e-f15a-431f-a9eb-cc44dd8c0079 tempest-VolumeImageDependencyTests-673617125 None] Created volume successfully. Sep 07 17:13:44 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:44 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 is being set with open permissions: ugo+rw Sep 07 17:13:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:44 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 Sep 07 17:13:44 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:45 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Deleted volume successfully. Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b2aebb37-bfa2-4b91-bc5b-4c6792cc1197 tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-3ec5922d-75c8-4937-be76-c3b7e32c9ba6-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:45 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:45 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info Sep 07 17:13:45 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:45 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:45 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info is being set with open permissions: ugo+rw Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:45 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info Sep 07 17:13:45 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:45 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.info" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.459s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:45 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-965ea48d-d310-4dee-b72f-e4e0c656553f tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-86f1282d-3730-4ee9-8957-af556a2e8061-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-86f1282d-3730-4ee9-8957-af556a2e8061-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-quobyte-86f1282d-3730-4ee9-8957-af556a2e8061" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-86f1282d-3730-4ee9-8957-af556a2e8061" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[47a84b53-ba0d-403a-8318-6d10b693f866]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Acquiring lock "cinder-6c48aa00-bcc1-47e4-8394-c1d80c2302c7-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "cinder-6c48aa00-bcc1-47e4-8394-c1d80c2302c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Acquiring lock "cinder-quobyte-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "cinder-quobyte-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:46 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 Sep 07 17:13:46 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e527f-c35a-42ac-9de2-b01000b5b26b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:46 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 Sep 07 17:13:46 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:46 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:46 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061 Sep 07 17:13:46 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-d50282bd-c9af-4d0e-a107-2aee01bdfcd4-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:46 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d50282bd-c9af-4d0e-a107-2aee01bdfcd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:46 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7 Sep 07 17:13:46 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-d50282bd-c9af-4d0e-a107-2aee01bdfcd4" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d50282bd-c9af-4d0e-a107-2aee01bdfcd4" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot d50282bd-c9af-4d0e-a107-2aee01bdfcd4 of volume c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[91166ee6-ac60-49ba-aa15-5fda89b6a95a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:46 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-86f1282d-3730-4ee9-8957-af556a2e8061" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:46 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 Sep 07 17:13:46 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-86f1282d-3730-4ee9-8957-af556a2e8061" released by "delete_volume" :: held 0.886s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:46 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "cinder-quobyte-6c48aa00-bcc1-47e4-8394-c1d80c2302c7" released by "delete_volume" :: held 0.762s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Created reservations ['04f0f3df-5785-43e4-acee-5bb5884ef4ef', 'ddb2e5d4-be51-4867-945e-6d8241544bb6', '60e0c0e8-28f7-4541-a2c2-cc9ba35a9f77', 'f826fa49-c0dc-4456-9023-ea9dd3260455'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:46 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Created reservations ['fd2f9d83-fd91-43a3-a214-8a0d430f4455', 'f6ca9c05-d577-4b7a-85f4-a42b8298132a', 'a74bdc6b-855b-4bb6-ad57-339e2ec77a74', '0cdb9fe9-c334-4f66-9bea-d5e48cf78a64'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-8451e96d-2072-45a8-9e74-79c8bc31e062-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:47 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:47 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-8451e96d-2072-45a8-9e74-79c8bc31e062-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:47 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "cinder-quobyte-8451e96d-2072-45a8-9e74-79c8bc31e062" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:47 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4" returned: 0 in 0.596s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-8451e96d-2072-45a8-9e74-79c8bc31e062" acquired by "delete_volume" :: waited 0.079s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98029dc-cd22-4a46-b154-4aef7f991a09]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[989d117d-4d2e-49d5-b0f7-1245eb638c8c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:47 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (fe5fd116-5b41-4c3a-ba46-9bfa3e98c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e7f130-b057-4be3-9275-f45bae2961ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Deleted volume successfully. Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58e7f130-b057-4be3-9275-f45bae2961ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734628091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf7db16-7889-460d-ba31-062d3387f599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:47Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:47 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f Sep 07 17:13:47 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71af65d-6e6f-49ff-bf03-c7c16dbfdb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d71af65d-6e6f-49ff-bf03-c7c16dbfdb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac815f59-678d-47d1-8d4d-32407af57716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac815f59-678d-47d1-8d4d-32407af57716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cf7db16-7889-460d-ba31-062d3387f599', 'volume_name': 'volume-4cf7db16-7889-460d-ba31-062d3387f599', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:47 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 Sep 07 17:13:47 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5a5085-891f-4c79-8466-a2bbf8f50eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e5a5085-891f-4c79-8466-a2bbf8f50eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f449b-7374-445c-a397-6cb60ea99dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:47 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume 4cf7db16-7889-460d-ba31-062d3387f599: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cf7db16-7889-460d-ba31-062d3387f599', 'volume_size': 1} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1734628091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cf7db16-7889-460d-ba31-062d3387f599,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:47Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume 4cf7db16-7889-460d-ba31-062d3387f599 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:47 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-539ea91c-966a-4a89-bd08-404a6596b7fa tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-86f1282d-3730-4ee9-8957-af556a2e8061-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:47 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 1073741824 Sep 07 17:13:47 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.489s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:47 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Deleted volume successfully. Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9e115b64-a48d-4374-8c77-510236be7bd9 tempest-VolumeImageDependencyTests-673617125 None] Lock "cinder-6c48aa00-bcc1-47e4-8394-c1d80c2302c7-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:47 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062" returned: 0 in 0.504s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062 Sep 07 17:13:47 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:47 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" returned: 0 in 0.564s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:47 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 Sep 07 17:13:47 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:48 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 1073741824" returned: 0 in 0.564s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:48 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8451e96d-2072-45a8-9e74-79c8bc31e062" returned: 0 in 0.328s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-quobyte-8451e96d-2072-45a8-9e74-79c8bc31e062" released by "delete_volume" :: held 0.895s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:48 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Created reservations ['436e5a4e-dfac-4e4a-9bdc-6dc4d82b88c4', '4dc1811a-6533-43fa-a7c7-1300970fb77b', '0dbce7ef-50d2-4228-a5b3-6d87eccbe03a', '6f781db8-60a4-4680-b337-c93e7c8d1d82'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:48 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:48 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:48 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4" returned: 0 in 0.522s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:48 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4 Sep 07 17:13:48 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:48 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599" returned: 0 in 0.360s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72f449b-7374-445c-a397-6cb60ea99dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cf7db16-7889-460d-ba31-062d3387f599', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6bb26c-e76a-4455-b9d0-51b63310cf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:48 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-4cf7db16-7889-460d-ba31-062d3387f599 (4cf7db16-7889-460d-ba31-062d3387f599): created successfully Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d6bb26c-e76a-4455-b9d0-51b63310cf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (fe5fd116-5b41-4c3a-ba46-9bfa3e98c050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0418d853-06b3-4697-98dc-69f601514d5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:48 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.324s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Deleted volume successfully. Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-103bbf9c-bca2-4b0c-b2f8-210d6270a5eb tempest-CreateVolumesFromImageTest-864349796 None] Lock "cinder-8451e96d-2072-45a8-9e74-79c8bc31e062-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:48 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f.d50282bd-c9af-4d0e-a107-2aee01bdfcd4" returned: 0 in 0.381s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d50282bd-c9af-4d0e-a107-2aee01bdfcd4" released by "_delete_snapshot" :: held 2.193s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" released by "delete_snapshot" :: held 2.233s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Created reservations ['46de10ba-a257-4ce2-9b9b-ab834cfe4048', '570a24aa-76d4-4f40-9cf9-a622f6b4fabc', '7845465c-7bf8-439e-89ac-6ad8e27b0cec', '54a612f3-a87c-4c6b-8bca-7a7dfdd72826'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2f983d5b-f9e8-4245-8cdd-6fb7fbce009e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d50282bd-c9af-4d0e-a107-2aee01bdfcd4-delete_snapshot" released by "delete_snapshot" :: held 2.437s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b0591d-a456-47b4-b0d1-0144d0843f3a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (1e33a023-636a-4f72-8b59-816e6c478b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b229903b-3c4b-40a5-8836-4b069e550d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b229903b-3c4b-40a5-8836-4b069e550d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141659318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5aca4e-f35c-424b-8519-b4df42119a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:50Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b9eec-eb63-43dc-81a9-5339dbddebee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (716b9eec-eb63-43dc-81a9-5339dbddebee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f Sep 07 17:13:50 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba98e5ef-d1da-4f7c-931d-650539dcb064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba98e5ef-d1da-4f7c-931d-650539dcb064) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb5aca4e-f35c-424b-8519-b4df42119a64', 'volume_name': 'volume-bb5aca4e-f35c-424b-8519-b4df42119a64', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff043d1c-3775-42ed-93b7-aeee5b6191b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff043d1c-3775-42ed-93b7-aeee5b6191b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0283b2eb-8155-4952-9157-d048956eab3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume bb5aca4e-f35c-424b-8519-b4df42119a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb5aca4e-f35c-424b-8519-b4df42119a64', 'volume_size': 1} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-141659318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb5aca4e-f35c-424b-8519-b4df42119a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:50Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume bb5aca4e-f35c-424b-8519-b4df42119a64 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:50 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:50 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 1073741824 Sep 07 17:13:50 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:50 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" returned: 0 in 0.547s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:50 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f Sep 07 17:13:50 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (606da9e5-2576-4f69-9629-91e98befb0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5a7dd0-eb8c-4724-a9cf-66647ee9e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d5a7dd0-eb8c-4724-a9cf-66647ee9e9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1284920218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f0190-0777-4084-a4c9-939df2fd6876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:51Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91abd654-ff91-4268-8337-e8500387a729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91abd654-ff91-4268-8337-e8500387a729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d48ab9-e2de-4352-9245-19c2ba0eefb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0d48ab9-e2de-4352-9245-19c2ba0eefb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051f0190-0777-4084-a4c9-939df2fd6876', 'volume_name': 'volume-051f0190-0777-4084-a4c9-939df2fd6876', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3280c80b-74af-437c-8f1c-3fc8a02a6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3280c80b-74af-437c-8f1c-3fc8a02a6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdf66dd-a0fa-4424-a01d-7a66f0fcf844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:50 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume 051f0190-0777-4084-a4c9-939df2fd6876: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051f0190-0777-4084-a4c9-939df2fd6876', 'volume_size': 1} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:50 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f" released by "delete_volume" :: held 1.079s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Created reservations ['0be9e76d-189f-42c8-846e-13a42c14ae31', '2b4d6c06-a159-412a-ac03-81f3b85ffbbc', '5414e038-7db8-48ac-ab13-e87fc4bfedb0', '816e2ae1-2c2e-4ee3-8c8a-08122d8efd24'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:51 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (a27b7b3e-5cbe-430c-8d56-bdc4cbad1419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1d5f6d-2d59-4dd9-ad46-461dd3ce0e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 1073741824" returned: 0 in 0.983s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df1d5f6d-2d59-4dd9-ad46-461dd3ce0e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302706260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55e0b0d-3e26-4537-89d7-c34b77a54b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:51Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2e1d1c-3246-4420-a341-cfeb33258d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a2e1d1c-3246-4420-a341-cfeb33258d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065c5076-e254-494f-b897-443353d6093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (065c5076-e254-494f-b897-443353d6093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd55e0b0d-3e26-4537-89d7-c34b77a54b2d', 'volume_name': 'volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c905d657-4665-4589-b3f4-971d775e6c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c905d657-4665-4589-b3f4-971d775e6c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5c0b4-56bb-45ab-8ba0-59b1f99169b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume d55e0b0d-3e26-4537-89d7-c34b77a54b2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d', 'volume_size': 1} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:51 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 Sep 07 17:13:51 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:51 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:51 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:51 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:13:51 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64" returned: 0 in 0.466s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5b7df24d-4c2e-4c03-baf5-59ef8396ccab tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c3c24dc9-39c6-41f3-85f0-d21ab2134e6f-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1284920218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051f0190-0777-4084-a4c9-939df2fd6876,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:51Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume 051f0190-0777-4084-a4c9-939df2fd6876 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:51 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:51 devstack sudo[106339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 1073741824 Sep 07 17:13:51 devstack sudo[106339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0283b2eb-8155-4952-9157-d048956eab3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb5aca4e-f35c-424b-8519-b4df42119a64', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa0bda-819c-4a71-9119-ae11fbc452d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (9c4ed08a-7a22-4ce3-88a7-d7a1254187fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ba4aae-c0ad-46a4-a066-4e7b466f091c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-bb5aca4e-f35c-424b-8519-b4df42119a64 (bb5aca4e-f35c-424b-8519-b4df42119a64): created successfully Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cafa0bda-819c-4a71-9119-ae11fbc452d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (1e33a023-636a-4f72-8b59-816e6c478b75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82ba4aae-c0ad-46a4-a066-4e7b466f091c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424207854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873572e2-8be0-47d0-af39-a540ef339737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:52Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3063289d-8d34-4011-8680-7eca4df85c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3063289d-8d34-4011-8680-7eca4df85c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ef2979-c1f3-4bce-b2eb-6d0e970e5880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19ef2979-c1f3-4bce-b2eb-6d0e970e5880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '873572e2-8be0-47d0-af39-a540ef339737', 'volume_name': 'volume-873572e2-8be0-47d0-af39-a540ef339737', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf0ff8-8e03-4ce6-9e7a-2968a24a8d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:51 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aaf0ff8-8e03-4ce6-9e7a-2968a24a8d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6223813e-7d13-46cd-b5f3-1170e8db9d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume 873572e2-8be0-47d0-af39-a540ef339737: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-873572e2-8be0-47d0-af39-a540ef339737', 'volume_size': 1} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-aa5d0d40-1544-405a-8e65-c67be9d0cf68 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (e559fa10-1999-4b48-b8c1-64b234ccdc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcef6e8-4117-4aa1-9e00-f89a215e5afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dcef6e8-4117-4aa1-9e00-f89a215e5afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377461115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794d44c0-e267-4bf7-97f4-d51145c0f9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:52Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19aef4d4-33dd-4a42-a326-54a969c42930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19aef4d4-33dd-4a42-a326-54a969c42930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7048a0d-d552-42eb-bc55-c20371575710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack sudo[106339]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7048a0d-d552-42eb-bc55-c20371575710) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '794d44c0-e267-4bf7-97f4-d51145c0f9d3', 'volume_name': 'volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e819725-30da-4551-9209-56fbd875a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e819725-30da-4551-9209-56fbd875a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aab48e-5ca5-4fa3-84b5-23a22520fa70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume 794d44c0-e267-4bf7-97f4-d51145c0f9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3', 'volume_size': 1} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 1073741824" returned: 0 in 0.765s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:52 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 Sep 07 17:13:52 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (2cf36ee4-eb43-403b-9eb6-3ced8794011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cf254e-b2fd-4ca9-b5e9-b6687af403cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06cf254e-b2fd-4ca9-b5e9-b6687af403cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758884727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0a6b41-e766-4c8a-aaf0-d954e289decb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:53Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f86136-32e5-4c43-8a8f-c5b867b36976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f86136-32e5-4c43-8a8f-c5b867b36976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b491a-bcc6-49a2-881c-b37f54315157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09b491a-bcc6-49a2-881c-b37f54315157) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d0a6b41-e766-4c8a-aaf0-d954e289decb', 'volume_name': 'volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee27ebd1-c433-4bb4-a7d5-b1e72acf4043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee27ebd1-c433-4bb4-a7d5-b1e72acf4043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aa417c-6876-4e12-8e91-70dde4f6f217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Volume 2d0a6b41-e766-4c8a-aaf0-d954e289decb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb', 'volume_size': 1} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876" returned: 0 in 0.340s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.705s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1302706260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d55e0b0d-3e26-4537-89d7-c34b77a54b2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:51Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume d55e0b0d-3e26-4537-89d7-c34b77a54b2d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fdf66dd-a0fa-4424-a01d-7a66f0fcf844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051f0190-0777-4084-a4c9-939df2fd6876', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6ca01-f1a4-4526-9c27-d1768620f368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:52 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d 1073741824 Sep 07 17:13:52 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:52 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-051f0190-0777-4084-a4c9-939df2fd6876 (051f0190-0777-4084-a4c9-939df2fd6876): created successfully Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (faa6ca01-f1a4-4526-9c27-d1768620f368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:52 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (606da9e5-2576-4f69-9629-91e98befb0ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8ff44f9a-8c7c-4e4f-ae70-81bdbc99ec0f tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-aad6ac0a-b000-4fed-bc52-e7798c358312 tempest-ProjectAdminTests-558752223 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5174179077148, 'free_capacity_gb': 1773.5174179077148, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86783) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 17:13:53 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d 1073741824" returned: 0 in 0.453s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:53 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d Sep 07 17:13:53 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:53 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424207854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=873572e2-8be0-47d0-af39-a540ef339737,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:52Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume 873572e2-8be0-47d0-af39-a540ef339737 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:53 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:53 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 1073741824 Sep 07 17:13:53 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde5c0b4-56bb-45ab-8ba0-59b1f99169b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0305aa-da2a-489a-8ded-f1acfd2ed2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:53 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d (d55e0b0d-3e26-4537-89d7-c34b77a54b2d): created successfully Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e0305aa-da2a-489a-8ded-f1acfd2ed2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:53 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (a27b7b3e-5cbe-430c-8d56-bdc4cbad1419) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:53 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c6c07b02-e9ad-45ce-8da0-ba70d1cb035a tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:54 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 1073741824" returned: 0 in 0.516s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:54 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 Sep 07 17:13:54 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:54 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737" returned: 0 in 0.301s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.056s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-377461115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794d44c0-e267-4bf7-97f4-d51145c0f9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6351a57585364a40bfef2de51798a200',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:52Z,use_quota=True,user_id='e415a86282dc4167a9aa4799c5d15927',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Creating volume 794d44c0-e267-4bf7-97f4-d51145c0f9d3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:54 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6223813e-7d13-46cd-b5f3-1170e8db9d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-873572e2-8be0-47d0-af39-a540ef339737', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:54 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 1073741824 Sep 07 17:13:54 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742a222a-a65c-4ab4-8541-5cf28f5b9336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:54 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-873572e2-8be0-47d0-af39-a540ef339737 (873572e2-8be0-47d0-af39-a540ef339737): created successfully Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742a222a-a65c-4ab4-8541-5cf28f5b9336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:54 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (9c4ed08a-7a22-4ce3-88a7-d7a1254187fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:54 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9dabaff0-4585-4175-9aed-829ed729481c tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:55 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 1073741824" returned: 0 in 0.495s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:55 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 Sep 07 17:13:55 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:55 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.480s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1758884727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d0a6b41-e766-4c8a-aaf0-d954e289decb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:53Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Creating volume 2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:55 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07aab48e-5ca5-4fa3-84b5-23a22520fa70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c1eb98-34bc-4db4-a6e7-98b31aac0d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:55 devstack sudo[106382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb 1073741824 Sep 07 17:13:55 devstack sudo[106382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:55 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Volume volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 (794d44c0-e267-4bf7-97f4-d51145c0f9d3): created successfully Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c1eb98-34bc-4db4-a6e7-98b31aac0d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Flow 'volume_create_manager' (e559fa10-1999-4b48-b8c1-64b234ccdc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:55 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-17c3de2f-7581-495d-8782-a65a3a7938a2 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created volume successfully. Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-794d44c0-e267-4bf7-97f4-d51145c0f9d3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-794d44c0-e267-4bf7-97f4-d51145c0f9d3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-794d44c0-e267-4bf7-97f4-d51145c0f9d3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-794d44c0-e267-4bf7-97f4-d51145c0f9d3" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff2374a-7408-4499-9cdd-583c515537e4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:55 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:55 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 Sep 07 17:13:55 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:56 devstack sudo[106382]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb 1073741824" returned: 0 in 0.650s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:56 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb Sep 07 17:13:56 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:56 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3" returned: 0 in 0.499s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:56 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3 Sep 07 17:13:56 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:56 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb" returned: 0 in 0.303s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1aa417c-6876-4e12-8e91-70dde4f6f217) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d718c6-5d78-43e1-9571-3ae3071af112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:56 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Volume volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb (2d0a6b41-e766-4c8a-aaf0-d954e289decb): created successfully Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2d718c6-5d78-43e1-9571-3ae3071af112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (2cf36ee4-eb43-403b-9eb6-3ced8794011e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:56 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-67cad896-a314-48b4-830f-3d473c243017 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:13:56 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-794d44c0-e267-4bf7-97f4-d51145c0f9d3" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-794d44c0-e267-4bf7-97f4-d51145c0f9d3" released by "delete_volume" :: held 0.891s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['e70d43b2-f482-4713-b3fc-f9a80942874a', 'b4543f88-b6b7-4189-bd65-23d0a9035ec9', '7270f447-7669-466d-ba20-424b971f91bd', '0d24d7b1-fd32-4233-8be4-d4a9db5c9473'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:56 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:56 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-873572e2-8be0-47d0-af39-a540ef339737-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-873572e2-8be0-47d0-af39-a540ef339737-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-873572e2-8be0-47d0-af39-a540ef339737" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:56 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-873572e2-8be0-47d0-af39-a540ef339737" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde743cf-0d5b-4fe4-91ca-0495aaaf92fa]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:57 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.322s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:57 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-084aa02b-a797-4aac-91af-2104047b6a5b tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-794d44c0-e267-4bf7-97f4-d51145c0f9d3-delete_volume" released by "delete_volume" :: held 1.483s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:57 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 Sep 07 17:13:57 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot c85d88f4-db2a-4bbb-83e5-3e3d92a2849e of volume 2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec516c3-4624-43b4-8385-35fef0da984d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:57 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb Sep 07 17:13:57 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:57 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737" returned: 0 in 0.482s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:57 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737 Sep 07 17:13:57 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:57 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:57 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb" returned: 0 in 0.458s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-873572e2-8be0-47d0-af39-a540ef339737" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:57 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e 1G Sep 07 17:13:57 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-873572e2-8be0-47d0-af39-a540ef339737" released by "delete_volume" :: held 0.882s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:57 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['d9fbe2fc-8d66-4d6c-86df-6447b05e6147', 'e29318d4-5e52-4223-8199-2d7db790d253', '58c98fe5-30f1-4439-b8d8-79bf21754b51', '80883766-122e-4a64-bdb2-e3406ca8f34d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:58 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:58 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-d55e0b0d-3e26-4537-89d7-c34b77a54b2d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-d55e0b0d-3e26-4537-89d7-c34b77a54b2d-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6a4d74-4993-4713-96e7-d2aa1dd09161]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:13:58 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (4eb9c9e6-0392-4766-8563-b23896ef7b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9f781b-607a-4c83-bc04-5a782de1ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:58 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d9f781b-607a-4c83-bc04-5a782de1ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075173591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e765bb-a1fb-46c1-b20c-15976c338d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:58Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:58 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c25d800-7ce5-45c8-b025-04acbc2b9ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:58 devstack sudo[106424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d Sep 07 17:13:58 devstack sudo[106424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c25d800-7ce5-45c8-b025-04acbc2b9ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44ef54b-720a-4136-9bda-75bbd2cf478b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44ef54b-720a-4136-9bda-75bbd2cf478b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81e765bb-a1fb-46c1-b20c-15976c338d18', 'volume_name': 'volume-81e765bb-a1fb-46c1-b20c-15976c338d18', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e502f3ba-e7ef-4019-b756-c1451008868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e502f3ba-e7ef-4019-b756-c1451008868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca54a2a-abab-4b0d-a2bf-fca13b4450cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:13:58 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Volume 81e765bb-a1fb-46c1-b20c-15976c338d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81e765bb-a1fb-46c1-b20c-15976c338d18', 'volume_size': 1} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e 1G" returned: 0 in 0.700s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9de8e631-ef89-4dac-9cc2-cbf908c018aa tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-873572e2-8be0-47d0-af39-a540ef339737-delete_volume" released by "delete_volume" :: held 1.644s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:58 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e Sep 07 17:13:58 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:58 devstack sudo[106424]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" returned: 0 in 0.494s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:58 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d Sep 07 17:13:58 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:58 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:58 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e is being set with open permissions: ugo+rw Sep 07 17:13:58 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:58 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e Sep 07 17:13:58 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-d55e0b0d-3e26-4537-89d7-c34b77a54b2d" released by "delete_volume" :: held 0.821s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['376a90e3-c2e6-47b7-8031-dce817c9b5b1', '577dddc5-8565-4bcc-95e7-80df414e0ae4', '6b4d6f06-0bf6-4c05-adce-233541742c00', 'f5b8c601-8309-41ab-b18c-def38b2393ba'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:13:59 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:59 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info Sep 07 17:13:59 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:13:59 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-051f0190-0777-4084-a4c9-939df2fd6876-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-051f0190-0777-4084-a4c9-939df2fd6876-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-051f0190-0777-4084-a4c9-939df2fd6876" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-051f0190-0777-4084-a4c9-939df2fd6876" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[08777929-cc41-4472-aa10-2cfa567976a0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:59 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:59 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info is being set with open permissions: ugo+rw Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:59 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:13:59 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info Sep 07 17:13:59 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-00270606-7edd-47d8-b9f8-0de2afdc2fd9 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-d55e0b0d-3e26-4537-89d7-c34b77a54b2d-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:13:59 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 Sep 07 17:13:59 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.info" returned: 0 in 0.330s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.589s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.389s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2075173591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81e765bb-a1fb-46c1-b20c-15976c338d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:13:58Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Creating volume 81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:13:59 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:13:59 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:13:59 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 1073741824 Sep 07 17:13:59 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:13:59 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d09f2f2d-d892-4eb0-9887-8b78f9a232d6 tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:00 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876" returned: 0 in 0.473s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:00 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876 Sep 07 17:14:00 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:00 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-051f0190-0777-4084-a4c9-939df2fd6876" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-051f0190-0777-4084-a4c9-939df2fd6876" released by "delete_volume" :: held 0.777s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['750c0d04-19af-4943-b185-05dbacf13a80', 'd6233f21-7c88-48bd-b87e-d192dd964fe1', '00bdcf68-a176-4cf0-92a4-bffd0081412e', 'bf725e82-721b-41e6-b835-e1d5a51add0c'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:00 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:00 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:00 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 1073741824" returned: 0 in 0.545s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:00 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 Sep 07 17:14:00 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-bb5aca4e-f35c-424b-8519-b4df42119a64-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-bb5aca4e-f35c-424b-8519-b4df42119a64-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.061s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot c85d88f4-db2a-4bbb-83e5-3e3d92a2849e of volume 2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:00 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38839ef-1141-4c85-8c96-4e61ac7579d2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.378s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-bb5aca4e-f35c-424b-8519-b4df42119a64" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:00 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-bb5aca4e-f35c-424b-8519-b4df42119a64" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8485b2cc-036e-4874-b04c-442898abfab5 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-051f0190-0777-4084-a4c9-939df2fd6876-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[177a3301-5e08-4212-82bb-839a37a7a676]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:00 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ca54a2a-abab-4b0d-a2bf-fca13b4450cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81e765bb-a1fb-46c1-b20c-15976c338d18', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2decf9-479e-4fbe-a876-c4a4ced97fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:00 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e Sep 07 17:14:00 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:00 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Volume volume-81e765bb-a1fb-46c1-b20c-15976c338d18 (81e765bb-a1fb-46c1-b20c-15976c338d18): created successfully Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c2decf9-479e-4fbe-a876-c4a4ced97fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:00 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (4eb9c9e6-0392-4766-8563-b23896ef7b06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:01 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-872e80dc-8284-4968-a949-3152cd43a315 tempest-ProjectReaderTests-1468396590 None] Created volume successfully. Sep 07 17:14:01 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 Sep 07 17:14:01 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:01 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" returned: 0 in 0.440s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c200bfb4-9314-48db-a75e-a44299205ce8]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:01 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64" returned: 0 in 0.392s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:01 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64 Sep 07 17:14:01 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:01 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb Sep 07 17:14:01 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:01 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-bb5aca4e-f35c-424b-8519-b4df42119a64" returned: 0 in 0.273s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-bb5aca4e-f35c-424b-8519-b4df42119a64" released by "delete_volume" :: held 0.734s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['ddc20cf6-0937-45c4-bf74-bafb010755fa', 'd1e9627b-a372-4e5d-ae56-7d0a25f84769', '70289bcb-27f8-4e3c-969d-a647df83c309', '7d530c0c-5ff8-4827-9f20-efd71fb4a8a4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:01 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:01 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e Sep 07 17:14:01 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:01 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:01 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Creating offline snapshot d128237d-8819-4422-93b3-3e23b8f1f30b of volume 81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-4cf7db16-7889-460d-ba31-062d3387f599-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e5a774-7c57-4d5a-a81a-23bef32706d2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-4cf7db16-7889-460d-ba31-062d3387f599-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "cinder-quobyte-4cf7db16-7889-460d-ba31-062d3387f599" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-4cf7db16-7889-460d-ba31-062d3387f599" acquired by "delete_volume" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16400ba-54f8-48aa-a9f3-3268bf9cb3dc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:02 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 Sep 07 17:14:02 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:02 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:14:02 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" returned: 0 in 0.543s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7cd55fb4-a1c2-47fa-9444-5686850e9d60 tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-bb5aca4e-f35c-424b-8519-b4df42119a64-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:02 devstack sudo[106503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e Sep 07 17:14:02 devstack sudo[106503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:02 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 Sep 07 17:14:02 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:02 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18" returned: 0 in 0.531s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:02 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b 1G Sep 07 17:14:02 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:02 devstack sudo[106503]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb.c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e" released by "_delete_snapshot" :: held 1.856s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" released by "delete_snapshot" :: held 1.899s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:02 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599" returned: 0 in 0.591s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:02 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599 Sep 07 17:14:02 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Flow 'volume_create_manager' (158f8b61-421c-497b-8a09-8bee7e4c443b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85aed1e7-630b-4765-8263-3c5354d3ad13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85aed1e7-630b-4765-8263-3c5354d3ad13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138041464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4b41f4-99c3-42e1-8081-97827d039c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c767e6c339b45ac806d5148ca83bb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:03Z,use_quota=True,user_id='a3834b931dde44938b33a0df528eb05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1911e11d-6d59-4fb1-aa25-8257f1df0bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1911e11d-6d59-4fb1-aa25-8257f1df0bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7cdcf-9117-4664-aa21-8256b4eca173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d7cdcf-9117-4664-aa21-8256b4eca173) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b4b41f4-99c3-42e1-8081-97827d039c0d', 'volume_name': 'volume-6b4b41f4-99c3-42e1-8081-97827d039c0d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c8c0c2-ef88-4dd8-a1d1-fcbc1818e413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05c8c0c2-ef88-4dd8-a1d1-fcbc1818e413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3beff19-59a6-4e27-933c-85405073cc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Volume 6b4b41f4-99c3-42e1-8081-97827d039c0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b4b41f4-99c3-42e1-8081-97827d039c0d', 'volume_size': 1} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Created reservations ['ad5b62d6-a6b4-4ea6-95e7-e5de70fef231', '8cb53b3c-b67b-446c-a203-fab298142805', '36432e65-438b-4cc1-a202-eaab8f3464e4', '44e213a5-63af-40c2-a52a-1b876c4e9a98'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-4436f294-078b-44d1-b050-1bb15cae6998 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c85d88f4-db2a-4bbb-83e5-3e3d92a2849e-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:03 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b 1G" returned: 0 in 0.484s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e765bb-a1fb-46c1-b20c-15976c338d18 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:03 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e765bb-a1fb-46c1-b20c-15976c338d18 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b Sep 07 17:14:03 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:03 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-4cf7db16-7889-460d-ba31-062d3387f599" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-quobyte-4cf7db16-7889-460d-ba31-062d3387f599" released by "delete_volume" :: held 0.945s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Created reservations ['b1ff0aff-9cb8-45bf-aaa2-cc648466905d', 'c0f5ae19-e0a3-44a2-8aab-209e986b2387', '2a8546c3-d74e-4231-a932-8696750c58b4', '56af876a-0da0-4b50-8d90-dc85a5692c09'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:03 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:03 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:03 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81e765bb-a1fb-46c1-b20c-15976c338d18 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b is being set with open permissions: ugo+rw Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:03 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b Sep 07 17:14:03 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:03 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Deleted volume successfully. Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-87bf5467-0910-45a3-af09-8031098530dc tempest-CreateVolumesFromSourceVolumeTest-1669521660 None] Lock "cinder-4cf7db16-7889-460d-ba31-062d3387f599-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:03 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:03 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info Sep 07 17:14:03 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:03 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:03 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info is being set with open permissions: ugo+rw Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:03 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info Sep 07 17:14:03 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-2d0a6b41-e766-4c8a-aaf0-d954e289decb-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-2d0a6b41-e766-4c8a-aaf0-d954e289decb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b10245-9d3d-4df4-b5e2-735cfacb4853]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:04 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.info" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.181s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.233s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-138041464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b4b41f4-99c3-42e1-8081-97827d039c0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c767e6c339b45ac806d5148ca83bb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:03Z,use_quota=True,user_id='a3834b931dde44938b33a0df528eb05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Creating volume 6b4b41f4-99c3-42e1-8081-97827d039c0d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:04 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb Sep 07 17:14:04 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:04 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d 1073741824 Sep 07 17:14:04 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2faebb1e-83c6-4dbe-9693-a2d02303bf71 tempest-ProjectReaderTests-1468396590 None] Create snapshot completed successfully Sep 07 17:14:04 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:04 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb Sep 07 17:14:04 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:04 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d 1073741824" returned: 0 in 0.464s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:04 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d Sep 07 17:14:04 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:04 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2d0a6b41-e766-4c8a-aaf0-d954e289decb" returned: 0 in 0.289s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-2d0a6b41-e766-4c8a-aaf0-d954e289decb" released by "delete_volume" :: held 0.752s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Created reservations ['5313e766-77bf-464a-ae79-c688e1d6509a', '0df8b5fb-795b-420b-8317-6f9974797913', 'afb31d52-4296-4fff-94aa-c5d086b770eb', '76f7bb83-67b7-4f63-a8f4-68edcf8c5f07'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:04 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:04 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:04 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d" returned: 0 in 0.278s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3beff19-59a6-4e27-933c-85405073cc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b4b41f4-99c3-42e1-8081-97827d039c0d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5344db-a041-4fe0-b7ac-e58f1ddc43a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Volume volume-6b4b41f4-99c3-42e1-8081-97827d039c0d (6b4b41f4-99c3-42e1-8081-97827d039c0d): created successfully Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5344db-a041-4fe0-b7ac-e58f1ddc43a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Flow 'volume_create_manager' (158f8b61-421c-497b-8a09-8bee7e4c443b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:04 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d313b3e8-ec17-4813-8be1-0cb42d79900f tempest-ProjectReaderTests-376133943 None] Created volume successfully. Sep 07 17:14:05 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-7f050d63-8732-4b1c-b9f5-d169e160d852 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-2d0a6b41-e766-4c8a-aaf0-d954e289decb-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-d128237d-8819-4422-93b3-3e23b8f1f30b-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-d128237d-8819-4422-93b3-3e23b8f1f30b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-d128237d-8819-4422-93b3-3e23b8f1f30b" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-d128237d-8819-4422-93b3-3e23b8f1f30b" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Deleting offline snapshot d128237d-8819-4422-93b3-3e23b8f1f30b of volume 81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] snapshot_file for this snap is: volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cadd1cd-fb58-4abc-a613-1009f2b739df]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:05 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b Sep 07 17:14:05 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (7a6d091c-7559-4394-a7b1-aba655d8e176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24e4ad-8b95-4abe-bcba-d32780053c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a24e4ad-8b95-4abe-bcba-d32780053c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053716113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58e9a98-3b63-47e8-94c6-2fd97573306e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:06Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea95f16-4a84-477d-afba-e59fbc91e44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ea95f16-4a84-477d-afba-e59fbc91e44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44d6b45-7142-41a3-8c15-6336e5aeff55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44d6b45-7142-41a3-8c15-6336e5aeff55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd58e9a98-3b63-47e8-94c6-2fd97573306e', 'volume_name': 'volume-d58e9a98-3b63-47e8-94c6-2fd97573306e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e8fa91-2d31-4a9a-a083-300aa732b73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16e8fa91-2d31-4a9a-a083-300aa732b73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a16122f-0bf8-4601-a439-fa85e0f3b108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Volume d58e9a98-3b63-47e8-94c6-2fd97573306e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d58e9a98-3b63-47e8-94c6-2fd97573306e', 'volume_size': 1} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1053716113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d58e9a98-3b63-47e8-94c6-2fd97573306e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:06Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Creating volume d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:05 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:05 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e 1073741824 Sep 07 17:14:05 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:05 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81e765bb-a1fb-46c1-b20c-15976c338d18(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01f7488-f3dd-41ee-a436-3754063c134c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Acquiring lock "cinder-6b4b41f4-99c3-42e1-8081-97827d039c0d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "cinder-6b4b41f4-99c3-42e1-8081-97827d039c0d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:06 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 Sep 07 17:14:06 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Acquiring lock "cinder-quobyte-6b4b41f4-99c3-42e1-8081-97827d039c0d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "cinder-quobyte-6b4b41f4-99c3-42e1-8081-97827d039c0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a92950-2b9b-429d-b710-8c4359d53226]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e 1073741824" returned: 0 in 0.559s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e Sep 07 17:14:06 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:06 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d Sep 07 17:14:06 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:06 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18" returned: 0 in 0.508s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b Sep 07 17:14:06 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:06 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e" returned: 0 in 0.310s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a16122f-0bf8-4601-a439-fa85e0f3b108) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d58e9a98-3b63-47e8-94c6-2fd97573306e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:06 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b13a73-b2d2-41dc-b230-bbc3ddeb9fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d" returned: 0 in 0.451s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Volume volume-d58e9a98-3b63-47e8-94c6-2fd97573306e (d58e9a98-3b63-47e8-94c6-2fd97573306e): created successfully Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3b13a73-b2d2-41dc-b230-bbc3ddeb9fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:06 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d Sep 07 17:14:06 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (7a6d091c-7559-4394-a7b1-aba655d8e176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b656077-bd12-4e1c-9e31-e724798292c3 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=249,cinder:UPDATE=345,cinder:INSERT=83,cinder:DELETE=21 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:14:06 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b" returned: 0 in 0.425s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:06 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b Sep 07 17:14:06 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:07 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-6b4b41f4-99c3-42e1-8081-97827d039c0d" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "cinder-quobyte-6b4b41f4-99c3-42e1-8081-97827d039c0d" released by "delete_volume" :: held 0.809s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=245,cinder:INSERT=95,cinder:UPDATE=317,cinder:DELETE=39 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Created reservations ['cca63001-0fe4-44fc-9b71-25590d6d8593', '2ba53850-6ff6-4e94-8ca6-dab3de9e94cb', 'c15cbd87-0885-4577-96cc-61cd1c1c20b4', 'c78ca234-0d03-4489-9d28-5ab2656adaa3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:07 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18.d128237d-8819-4422-93b3-3e23b8f1f30b" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:07 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:07 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-d128237d-8819-4422-93b3-3e23b8f1f30b" released by "_delete_snapshot" :: held 1.812s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" released by "delete_snapshot" :: held 1.863s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Created reservations ['db35f9b6-9496-41fb-87cb-1bbb3703e8c1', 'a14cc44f-634e-4f58-9986-9e4550a84c89', 'e56acd61-329d-437c-a1a3-ee06af860014', '36cb45e3-3b7d-4288-b6e9-c36fe7eab77a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Delete snapshot completed successfully. Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-900aafbf-78cf-457a-aeb9-0855325bb83b tempest-ProjectReaderTests-1468396590 None] Lock "cinder-d128237d-8819-4422-93b3-3e23b8f1f30b-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:07 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.277s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Deleted volume successfully. Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b29e32e2-9ac4-4db0-8690-6ebecc5acf00 tempest-ProjectReaderTests-376133943 None] Lock "cinder-6b4b41f4-99c3-42e1-8081-97827d039c0d-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-81e765bb-a1fb-46c1-b20c-15976c338d18-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-81e765bb-a1fb-46c1-b20c-15976c338d18-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[080580d0-b9ef-45fc-8462-46962cd9f3c9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:08 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 Sep 07 17:14:08 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Flow 'volume_create_manager' (1a14f84a-784b-47de-afd6-401026cf409b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b491a8b-0908-4351-a8b9-40f750791772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b491a8b-0908-4351-a8b9-40f750791772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a64a16-902b-4379-9cdc-94b8906492e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a20ca93151a4823b1558f070db20622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:08Z,use_quota=True,user_id='10bb6efd5b4947de90d41733969a240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f385ba-7392-40db-ae77-82cb9e3d80ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f385ba-7392-40db-ae77-82cb9e3d80ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba092baa-885e-4da1-93cf-8b2c2b4457ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba092baa-885e-4da1-93cf-8b2c2b4457ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09a64a16-902b-4379-9cdc-94b8906492e9', 'volume_name': 'volume-09a64a16-902b-4379-9cdc-94b8906492e9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d461369c-26d9-4d43-92e0-125608c08baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d461369c-26d9-4d43-92e0-125608c08baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def835a4-4c23-49d5-ba23-8d9c7ea20b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Volume 09a64a16-902b-4379-9cdc-94b8906492e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09a64a16-902b-4379-9cdc-94b8906492e9', 'volume_size': 1} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09a64a16-902b-4379-9cdc-94b8906492e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a20ca93151a4823b1558f070db20622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:08Z,use_quota=True,user_id='10bb6efd5b4947de90d41733969a240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Creating volume 09a64a16-902b-4379-9cdc-94b8906492e9 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:08 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:08 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 1073741824 Sep 07 17:14:08 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Flow 'volume_create_manager' (f35f5893-5fb7-4296-8964-49ed86f4d4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2417bfb1-4435-4a32-a7db-c18930d626d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2417bfb1-4435-4a32-a7db-c18930d626d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941510839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc20be-66c6-4248-aa0e-def9b8ba099e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c767e6c339b45ac806d5148ca83bb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:08Z,use_quota=True,user_id='a3834b931dde44938b33a0df528eb05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2223e36-6dd5-478b-8690-13701bb950b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2223e36-6dd5-478b-8690-13701bb950b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce3a782-c790-48d5-b3ce-6d5a05c9b9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dce3a782-c790-48d5-b3ce-6d5a05c9b9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16bc20be-66c6-4248-aa0e-def9b8ba099e', 'volume_name': 'volume-16bc20be-66c6-4248-aa0e-def9b8ba099e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f231242-96aa-49e7-826f-7f10ea3caafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f231242-96aa-49e7-826f-7f10ea3caafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:08 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb7fc2-f5f3-4c89-856c-456a510124ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:08 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Volume 16bc20be-66c6-4248-aa0e-def9b8ba099e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16bc20be-66c6-4248-aa0e-def9b8ba099e', 'volume_size': 1} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18" returned: 0 in 0.408s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:08 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18 Sep 07 17:14:08 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:08 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-81e765bb-a1fb-46c1-b20c-15976c338d18" returned: 0 in 0.288s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-81e765bb-a1fb-46c1-b20c-15976c338d18" released by "delete_volume" :: held 0.765s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:08 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 1073741824" returned: 0 in 0.452s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Created reservations ['399d94d4-b588-4261-9045-9f0b996de4c6', '08dad2d2-2f49-4a5f-b1cd-19798b9cdb5e', 'c7aabca1-40ff-4238-9362-8c4447b43dba', '915f18b8-2d2d-49ee-be4a-9ecd81a0b5c0'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:08 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 Sep 07 17:14:08 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:08 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:08 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:08 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.687s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (def835a4-4c23-49d5-ba23-8d9c7ea20b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09a64a16-902b-4379-9cdc-94b8906492e9', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7002332e-d595-4a4e-b442-fe37ef681981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot 61ced550-e627-4f39-bf23-c5dbfba149a9 of volume d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b363c915-84a6-4f0c-929c-5ad0654f70bd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Volume volume-09a64a16-902b-4379-9cdc-94b8906492e9 (09a64a16-902b-4379-9cdc-94b8906492e9): created successfully Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7002332e-d595-4a4e-b442-fe37ef681981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Flow 'volume_create_manager' (1a14f84a-784b-47de-afd6-401026cf409b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:09 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Deleted volume successfully. Sep 07 17:14:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9d63294e-1bdc-4482-bcd1-00eb5f6d8426 tempest-CinderUnicodeTest-1977786242 None] Created volume successfully. Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-37c85643-d52a-4152-beb8-94780fa64894 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-81e765bb-a1fb-46c1-b20c-15976c338d18-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:09 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e Sep 07 17:14:09 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:09 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (7f893676-24ee-445b-94d8-efec57a938b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03484676-a6e2-4b8c-8fd1-8cfc7d622c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:09 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 1G Sep 07 17:14:09 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03484676-a6e2-4b8c-8fd1-8cfc7d622c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509341064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be68aff2-d794-4fe5-a8cf-09a4c66f76e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:09Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e2deac-7a1a-4a58-88d5-51829142f7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9e2deac-7a1a-4a58-88d5-51829142f7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792df534-ab33-4d97-a6f6-a4ca94eb33cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (792df534-ab33-4d97-a6f6-a4ca94eb33cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be68aff2-d794-4fe5-a8cf-09a4c66f76e3', 'volume_name': 'volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b08502-bc9e-4654-988d-7ad528fba02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47b08502-bc9e-4654-988d-7ad528fba02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60642dff-daf9-433e-8184-a02fc603e6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Volume be68aff2-d794-4fe5-a8cf-09a4c66f76e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3', 'volume_size': 1} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:09 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:09 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:09 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 1G" returned: 0 in 0.394s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e9a98-3b63-47e8-94c6-2fd97573306e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:09 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e9a98-3b63-47e8-94c6-2fd97573306e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 Sep 07 17:14:09 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:10 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.285s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:14:10 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d58e9a98-3b63-47e8-94c6-2fd97573306e -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:10 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 is being set with open permissions: ugo+rw Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:10 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 Sep 07 17:14:10 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:10 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Flow 'volume_create_manager' (f8ef6fb1-31a5-4172-b91d-e36aebf69e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e146d96a-a8b4-45ca-9944-bfe99bfb5754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e146d96a-a8b4-45ca-9944-bfe99bfb5754) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1758930254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26907227-2f8c-4491-9269-38ffd48a8233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a20ca93151a4823b1558f070db20622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:10Z,use_quota=True,user_id='10bb6efd5b4947de90d41733969a240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05b62d7-3a31-4ed5-be91-0e47aca1f395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e05b62d7-3a31-4ed5-be91-0e47aca1f395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2711536b-6eb0-46f3-857a-b9738cf32532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2711536b-6eb0-46f3-857a-b9738cf32532) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26907227-2f8c-4491-9269-38ffd48a8233', 'volume_name': 'volume-26907227-2f8c-4491-9269-38ffd48a8233', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f770aecf-a415-4665-a2f6-2c622ee3e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f770aecf-a415-4665-a2f6-2c622ee3e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d467109-b575-4b2e-9529-c69aed10341d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Volume 26907227-2f8c-4491-9269-38ffd48a8233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26907227-2f8c-4491-9269-38ffd48a8233', 'volume_size': 1} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:10 devstack sudo[106644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info Sep 07 17:14:10 devstack sudo[106644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:10 devstack sudo[106644]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:10 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info is being set with open permissions: ugo+rw Sep 07 17:14:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:10 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info Sep 07 17:14:10 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:11 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.info" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.717s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941510839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16bc20be-66c6-4248-aa0e-def9b8ba099e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c767e6c339b45ac806d5148ca83bb47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:08Z,use_quota=True,user_id='a3834b931dde44938b33a0df528eb05b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Creating volume 16bc20be-66c6-4248-aa0e-def9b8ba099e {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:11 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e 1073741824 Sep 07 17:14:11 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-14a66aa7-a38d-4ea0-a16b-338ef2f3002e tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:11 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e 1073741824" returned: 0 in 0.427s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:11 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e Sep 07 17:14:11 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:11 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.253s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1509341064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be68aff2-d794-4fe5-a8cf-09a4c66f76e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:09Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Creating volume be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:11 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1bb7fc2-f5f3-4c89-856c-456a510124ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16bc20be-66c6-4248-aa0e-def9b8ba099e', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:11 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 1073741824 Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9751e6-4db2-41ac-a998-c494cdf6951f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:11 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:11 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Volume volume-16bc20be-66c6-4248-aa0e-def9b8ba099e (16bc20be-66c6-4248-aa0e-def9b8ba099e): created successfully Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9751e6-4db2-41ac-a998-c494cdf6951f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:11 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Flow 'volume_create_manager' (f35f5893-5fb7-4296-8964-49ed86f4d4ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:11 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f1f2b1e7-6a58-4e57-bc28-36e34b7662fa tempest-ProjectReaderTests-376133943 None] Created volume successfully. Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Acquiring lock "cinder-16bc20be-66c6-4248-aa0e-def9b8ba099e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "cinder-16bc20be-66c6-4248-aa0e-def9b8ba099e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Acquiring lock "cinder-quobyte-16bc20be-66c6-4248-aa0e-def9b8ba099e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "cinder-quobyte-16bc20be-66c6-4248-aa0e-def9b8ba099e" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d20cec3-943b-4d80-9138-3499018f2244]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:12 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-61ced550-e627-4f39-bf23-c5dbfba149a9-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 1073741824" returned: 0 in 0.493s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-61ced550-e627-4f39-bf23-c5dbfba149a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-61ced550-e627-4f39-bf23-c5dbfba149a9" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-61ced550-e627-4f39-bf23-c5dbfba149a9" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot 61ced550-e627-4f39-bf23-c5dbfba149a9 of volume d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:12 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 Sep 07 17:14:12 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:12 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e Sep 07 17:14:12 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef3e38-926d-4b03-b627-70a07f821aa5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:12 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 Sep 07 17:14:12 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:12 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.850s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.106s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:10Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1758930254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26907227-2f8c-4491-9269-38ffd48a8233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a20ca93151a4823b1558f070db20622',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:10Z,use_quota=True,user_id='10bb6efd5b4947de90d41733969a240e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Creating volume 26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:12 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:12 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 1073741824 Sep 07 17:14:12 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60642dff-daf9-433e-8184-a02fc603e6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913c07c4-b5fe-48d0-aa6c-8ab51c3a1e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:12 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:12 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Volume volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 (be68aff2-d794-4fe5-a8cf-09a4c66f76e3): created successfully Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (913c07c4-b5fe-48d0-aa6c-8ab51c3a1e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (7f893676-24ee-445b-94d8-efec57a938b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e" returned: 0 in 0.459s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:12 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-96333f77-183b-4cc6-a7e9-3125f7dd1cc5 tempest-ProjectReaderTests-1468396590 None] Created volume successfully. Sep 07 17:14:12 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e Sep 07 17:14:12 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:12 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d58e9a98-3b63-47e8-94c6-2fd97573306e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf11bd-982b-4ccf-8353-f2cda6b29a7a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:13 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e Sep 07 17:14:13 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:13 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-16bc20be-66c6-4248-aa0e-def9b8ba099e" returned: 0 in 0.281s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "cinder-quobyte-16bc20be-66c6-4248-aa0e-def9b8ba099e" released by "delete_volume" :: held 0.788s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Created reservations ['b61843d9-38b8-49d2-9901-8a1394277fcf', 'a5a1457c-a73d-4840-b74b-a5a13d0a6aef', 'c3e5961b-54b8-487e-ac77-293a18079745', 'd6b54e76-26f8-4d28-9c3f-a86367bc4727'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:13 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 1073741824" returned: 0 in 0.456s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:13 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:13 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:13 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 Sep 07 17:14:13 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:13 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:13 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 Sep 07 17:14:13 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:13 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Deleted volume successfully. Sep 07 17:14:13 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9a344a3a-1482-4909-94b0-11cda85f7930 tempest-ProjectReaderTests-376133943 None] Lock "cinder-16bc20be-66c6-4248-aa0e-def9b8ba099e-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233" returned: 0 in 0.338s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d467109-b575-4b2e-9529-c69aed10341d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26907227-2f8c-4491-9269-38ffd48a8233', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ab32a-7e02-49d9-8337-f8ade1bff504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:13 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Volume volume-26907227-2f8c-4491-9269-38ffd48a8233 (26907227-2f8c-4491-9269-38ffd48a8233): created successfully Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (653ab32a-7e02-49d9-8337-f8ade1bff504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Flow 'volume_create_manager' (f8ef6fb1-31a5-4172-b91d-e36aebf69e39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-06cae376-5eb6-43c4-adda-b01ec1e9ce9d tempest-CinderUnicodeTest-1977786242 None] Created volume successfully. Sep 07 17:14:13 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9" returned: 0 in 0.428s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:13 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9 Sep 07 17:14:13 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Creating offline snapshot d2f6e15e-b958-4afd-959c-04a8711aca5e of volume be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[788e4018-4324-4e3c-8078-8ceef3b846d2]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:14 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e.61ced550-e627-4f39-bf23-c5dbfba149a9" returned: 0 in 0.297s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:14 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 Sep 07 17:14:14 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-61ced550-e627-4f39-bf23-c5dbfba149a9" released by "_delete_snapshot" :: held 1.717s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" released by "delete_snapshot" :: held 1.756s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Created reservations ['f18e367c-4ef6-4994-af94-a0de708d8b29', '2ac1cedc-c4f3-49f7-a025-f074720e8e38', '1f039087-d69a-478d-9d5f-da29f99ff5aa', '748ced69-1af2-4afe-8a75-2179907681ae'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:14 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-45d0ac16-9203-4471-8be3-8b02e847c779 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-61ced550-e627-4f39-bf23-c5dbfba149a9-delete_snapshot" released by "delete_snapshot" :: held 1.928s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:14 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" returned: 0 in 0.407s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:14 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e 1G Sep 07 17:14:14 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-d58e9a98-3b63-47e8-94c6-2fd97573306e-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d58e9a98-3b63-47e8-94c6-2fd97573306e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" acquired by "delete_volume" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[80709237-77b3-4139-8cb6-04aa41403c3d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:14 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e Sep 07 17:14:14 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:14 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e 1G" returned: 0 in 0.606s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:14 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:15 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e Sep 07 17:14:15 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:15 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e" returned: 0 in 0.570s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:15 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e Sep 07 17:14:15 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:15 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:15 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e is being set with open permissions: ugo+rw Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:15 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e Sep 07 17:14:15 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:15 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-d58e9a98-3b63-47e8-94c6-2fd97573306e" returned: 0 in 0.291s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-d58e9a98-3b63-47e8-94c6-2fd97573306e" released by "delete_volume" :: held 0.959s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Created reservations ['58c3bfe3-4ce8-45e6-a48d-a6792cb4078e', '5f54a63d-b789-4df4-8a2c-563b0c2b048d', '0c688a84-e7b3-4290-adbe-d8f13b73281d', '01773426-6659-447f-887d-aeeee038403d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:15 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e" returned: 0 in 0.298s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:15 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info Sep 07 17:14:15 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:15 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:15 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:15 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:15 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info is being set with open permissions: ugo+rw Sep 07 17:14:15 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:16 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.266s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:16 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info Sep 07 17:14:16 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f3b7989f-32f3-4c22-a510-74be8c536c91 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-d58e9a98-3b63-47e8-94c6-2fd97573306e-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:16 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.info" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.047s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Creating offline snapshot cd79dd6d-e31d-4810-a8c4-4b9bc329720c of volume 26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:16 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e54fdc4-e38e-4320-b550-b8dd5be87005 tempest-ProjectReaderTests-1468396590 None] Create snapshot completed successfully Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae951de-1920-4124-91df-e3a73ca91634]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:16 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 Sep 07 17:14:16 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:16 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233" returned: 0 in 0.355s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:16 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:16 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c 1G Sep 07 17:14:16 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:17 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c 1G" returned: 0 in 0.461s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26907227-2f8c-4491-9269-38ffd48a8233 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-d2f6e15e-b958-4afd-959c-04a8711aca5e-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:17 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26907227-2f8c-4491-9269-38ffd48a8233 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c Sep 07 17:14:17 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-d2f6e15e-b958-4afd-959c-04a8711aca5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-d2f6e15e-b958-4afd-959c-04a8711aca5e" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-d2f6e15e-b958-4afd-959c-04a8711aca5e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Deleting offline snapshot d2f6e15e-b958-4afd-959c-04a8711aca5e of volume be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] snapshot_file for this snap is: volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d423a5-64af-4233-b3c8-eda9961efc41]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (9d7f4f4a-34fb-450d-a7f9-e75cdbe380c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979fd140-f0dd-4951-9cbc-833bfc600a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979fd140-f0dd-4951-9cbc-833bfc600a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896612821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d2cf9e-1507-49e6-8d95-7e8cffb29989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:17Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ce4fd4-1177-4464-914a-8c6a915376a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04ce4fd4-1177-4464-914a-8c6a915376a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3babf3ba-5aa4-4b10-85ad-d680c310594d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3babf3ba-5aa4-4b10-85ad-d680c310594d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d2cf9e-1507-49e6-8d95-7e8cffb29989', 'volume_name': 'volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7caba287-39a9-414b-aa1b-99849da83313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7caba287-39a9-414b-aa1b-99849da83313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0f89e-596d-41d4-936f-fb2d403a119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:17 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Volume f7d2cf9e-1507-49e6-8d95-7e8cffb29989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989', 'volume_size': 1} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:17 devstack sudo[106756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e Sep 07 17:14:17 devstack sudo[106756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:17 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26907227-2f8c-4491-9269-38ffd48a8233 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c" returned: 0 in 0.326s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:17 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c is being set with open permissions: ugo+rw Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:17 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c Sep 07 17:14:17 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:17 devstack sudo[106756]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e" returned: 0 in 0.376s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[a941abb7-dea2-47e4-8717-7d9bba660292]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:17 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c" returned: 0 in 0.265s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:17 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:17 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info Sep 07 17:14:17 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:17 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 Sep 07 17:14:17 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info is being set with open permissions: ugo+rw Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:18 devstack sudo[106774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info Sep 07 17:14:18 devstack sudo[106774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" returned: 0 in 0.374s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:18 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e Sep 07 17:14:18 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack sudo[106774]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.info" returned: 0 in 0.271s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.025s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.914s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-896612821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d2cf9e-1507-49e6-8d95-7e8cffb29989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:17Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Creating volume f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:18 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:18 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 1073741824 Sep 07 17:14:18 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4394734e-46ad-4e40-9dad-930a49e819a7 tempest-CinderUnicodeTest-1977786242 None] Create snapshot completed successfully Sep 07 17:14:18 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e" returned: 0 in 0.371s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:18 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e Sep 07 17:14:18 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3.d2f6e15e-b958-4afd-959c-04a8711aca5e" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-d2f6e15e-b958-4afd-959c-04a8711aca5e" released by "_delete_snapshot" :: held 1.487s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" released by "delete_snapshot" :: held 1.521s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:18 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 1073741824" returned: 0 in 0.443s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:18 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 Sep 07 17:14:18 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Created reservations ['e3196194-bb3d-4acb-b53e-aba12d11f38d', '6585b032-0c0a-4feb-8cc1-136767f58086', '4159cc5b-6c74-4cd0-9939-3fafc0ca46ed', '0b42de67-a827-425a-a2e2-b3811c00c7f4'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:18 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Delete snapshot completed successfully. Sep 07 17:14:18 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-23c9c52b-8faa-4047-915e-492151602ce3 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-d2f6e15e-b958-4afd-959c-04a8711aca5e-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:19 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83f0f89e-596d-41d4-936f-fb2d403a119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2958b6b-4903-4635-8b7e-eb62c423d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:19 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Volume volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 (f7d2cf9e-1507-49e6-8d95-7e8cffb29989): created successfully Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2958b6b-4903-4635-8b7e-eb62c423d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (9d7f4f4a-34fb-450d-a7f9-e75cdbe380c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:19 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-68161cd6-0671-4d4e-abee-f6ef9d44daae tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-be68aff2-d794-4fe5-a8cf-09a4c66f76e3-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-be68aff2-d794-4fe5-a8cf-09a4c66f76e3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-cd79dd6d-e31d-4810-a8c4-4b9bc329720c-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" acquired by "delete_volume" :: waited 0.042s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3926c-4ec1-463d-a1ce-082cea2cadd6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-cd79dd6d-e31d-4810-a8c4-4b9bc329720c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot 4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 of volume f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-quobyte-cd79dd6d-e31d-4810-a8c4-4b9bc329720c" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-cd79dd6d-e31d-4810-a8c4-4b9bc329720c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Deleting offline snapshot cd79dd6d-e31d-4810-a8c4-4b9bc329720c of volume 26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] snapshot_file for this snap is: volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ab59a-a582-4c9b-8578-8c3976e9670b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fe6cb0-389b-46d9-aee3-4b488a1badf0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:19 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 Sep 07 17:14:19 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:19 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 Sep 07 17:14:19 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:19 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c Sep 07 17:14:19 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:19 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:19 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:19 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3 Sep 07 17:14:19 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" returned: 0 in 0.385s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c" returned: 0 in 0.380s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26907227-2f8c-4491-9269-38ffd48a8233(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:20 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 1G Sep 07 17:14:20 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc8bbbb-200d-4cac-944f-30887cb506bc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 Sep 07 17:14:20 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-be68aff2-d794-4fe5-a8cf-09a4c66f76e3" released by "delete_volume" :: held 0.701s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Created reservations ['72d79a51-8b20-4fe3-b5fc-30f0e50347ae', '35f0fa97-b0b5-41dc-95a9-042af2287256', 'aa7ada3f-21c9-47cd-9c3e-8e5f78a157df', '089f5ad9-9ca1-48f2-8e1d-0a6faf552446'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:20 devstack sudo[106821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 1G" returned: 0 in 0.448s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233" returned: 0 in 0.413s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 Sep 07 17:14:20 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c Sep 07 17:14:20 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack sudo[106821]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:20 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Deleted volume successfully. Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bf56df8f-818f-4108-b304-2b865808c172 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-be68aff2-d794-4fe5-a8cf-09a4c66f76e3-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:20 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" returned: 0 in 0.356s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 is being set with open permissions: ugo+rw Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 Sep 07 17:14:20 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:20 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c" returned: 0 in 0.404s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:20 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:20 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c Sep 07 17:14:20 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (0dcb5f97-450b-4f1a-bcc6-4ba891022264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41bc78b-0e3e-4af7-b797-aaa91309937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:21 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:21 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41bc78b-0e3e-4af7-b797-aaa91309937b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505039359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db87052a-ed44-4fbc-97ec-b4700ef88e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:21Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a4535-ff62-450d-8b0e-5e614e319509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf3a4535-ff62-450d-8b0e-5e614e319509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c27f4ee-0d26-49c6-95d9-77ab9e974f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c27f4ee-0d26-49c6-95d9-77ab9e974f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db87052a-ed44-4fbc-97ec-b4700ef88e4c', 'volume_name': 'volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49925a8b-5d1c-463c-ba82-c68e9956d20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49925a8b-5d1c-463c-ba82-c68e9956d20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4179d008-4a1a-4459-8649-cf1bbef39ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:21 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Volume db87052a-ed44-4fbc-97ec-b4700ef88e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c', 'volume_size': 1} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233.cd79dd6d-e31d-4810-a8c4-4b9bc329720c" returned: 0 in 0.306s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-cd79dd6d-e31d-4810-a8c4-4b9bc329720c" released by "_delete_snapshot" :: held 1.644s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:21 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info Sep 07 17:14:21 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" released by "delete_snapshot" :: held 1.668s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Created reservations ['36114371-7fbd-48bc-9afc-8f2d5f197eb8', '066da19d-b1c4-4ef0-b4f3-b402e3c1ccf1', 'b5900ee6-3110-439a-8237-518ef0711c56', '7ae1a0f5-39ca-4146-a78a-5843c078d6f5'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Delete snapshot completed successfully. Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-ac51a444-9496-4a86-8e11-7b03b49cef76 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-cd79dd6d-e31d-4810-a8c4-4b9bc329720c-delete_snapshot" released by "delete_snapshot" :: held 1.825s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:21 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:21 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info is being set with open permissions: ugo+rw Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:21 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info Sep 07 17:14:21 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-26907227-2f8c-4491-9269-38ffd48a8233-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:21 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.info" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.206s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-26907227-2f8c-4491-9269-38ffd48a8233-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1505039359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db87052a-ed44-4fbc-97ec-b4700ef88e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:21Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Creating volume db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:21 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:21 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c 1073741824 Sep 07 17:14:21 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:21 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0fba173d-90fd-4baf-ae09-d86cbcd6bc49 tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[993fe0bc-8c34-4a8b-ba10-7000c6e4a9cf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:21 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:22 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 Sep 07 17:14:22 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:22 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c 1073741824" returned: 0 in 0.444s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:22 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c Sep 07 17:14:22 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:22 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233" returned: 0 in 0.416s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:22 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233 Sep 07 17:14:22 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:22 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4179d008-4a1a-4459-8649-cf1bbef39ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8733d4b0-b383-41b7-8239-ee0d003debe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:22 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:22 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Volume volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c (db87052a-ed44-4fbc-97ec-b4700ef88e4c): created successfully Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8733d4b0-b383-41b7-8239-ee0d003debe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (0dcb5f97-450b-4f1a-bcc6-4ba891022264) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-26907227-2f8c-4491-9269-38ffd48a8233" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-26907227-2f8c-4491-9269-38ffd48a8233" released by "delete_volume" :: held 0.738s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:22 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-87a1d753-1a6e-4c0e-94f6-511616fd3887 tempest-ProjectReaderTests-1468396590 None] Created volume successfully. Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Created reservations ['5a963066-982a-4872-aeba-86e652e52680', '63252d65-b760-42ce-845e-c4d5545dfd20', 'a82a37c2-11e8-439b-ac25-4b232e5755e0', '6ed1630b-40c1-4c8f-85b9-9f3cbd4b8763'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:22 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:22 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot 4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 of volume f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[40409a28-4396-41b5-bba9-125cb205520d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-09a64a16-902b-4379-9cdc-94b8906492e9-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-09a64a16-902b-4379-9cdc-94b8906492e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "cinder-quobyte-09a64a16-902b-4379-9cdc-94b8906492e9" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:22 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 Sep 07 17:14:22 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:22 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-09a64a16-902b-4379-9cdc-94b8906492e9" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b64fbb-d6a5-4570-9f89-aa933d1d2a7c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.282s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:23 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Deleted volume successfully. Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a140bc52-838e-49dd-96dc-9d93134ffcc9 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-26907227-2f8c-4491-9269-38ffd48a8233-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:23 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 Sep 07 17:14:23 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:23 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" returned: 0 in 0.476s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88d8c90-3726-44fb-9e48-2b63fdc313c9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Creating offline snapshot 87124394-c186-4438-a53f-0fc6a34732a7 of volume db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf26e459-63fc-4058-8dcd-8cab2cc8f0b9]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 Sep 07 17:14:23 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:23 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9" returned: 0 in 0.497s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9 Sep 07 17:14:23 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:23 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c Sep 07 17:14:23 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:23 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-09a64a16-902b-4379-9cdc-94b8906492e9" returned: 0 in 0.311s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack sudo[106894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 Sep 07 17:14:23 devstack sudo[106894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-quobyte-09a64a16-902b-4379-9cdc-94b8906492e9" released by "delete_volume" :: held 0.852s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:23 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:23 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Created reservations ['0682502a-d4ed-4064-8128-36838c08e9bf', '9f931a5b-f8ac-4032-8697-176a02139c52', 'a1531222-20b2-4ce6-9ef9-2bed86741fb1', '0a7a70c3-1eab-4e16-aad5-f2592895a1ce'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:23 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 1G Sep 07 17:14:23 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:24 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:24 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:24 devstack sudo[106894]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" returned: 0 in 0.449s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:24 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2 Sep 07 17:14:24 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:24 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.283s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Deleted volume successfully. Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-52779bc4-1a10-47aa-9d95-3eb67813ffb3 tempest-CinderUnicodeTest-1977786242 None] Lock "cinder-09a64a16-902b-4379-9cdc-94b8906492e9-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:24 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 1G" returned: 0 in 0.460s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:24 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 Sep 07 17:14:24 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:24 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989.4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" returned: 0 in 0.299s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2" released by "_delete_snapshot" :: held 1.790s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" released by "delete_snapshot" :: held 1.817s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Created reservations ['596568cd-9477-4543-85fa-ea942862b46e', '046d7313-9280-4c57-bd8e-59da91e657da', '08cf7f1e-7547-48d7-aa32-11d9e87d1805', '0c8eb187-6fbd-476f-a9e0-0b3395437c3e'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:24 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:24 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 is being set with open permissions: ugo+rw Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:24 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:24 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 Sep 07 17:14:24 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-58a86c52-765c-454a-89eb-ac28d5905115 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-4b7781c8-87e8-4ffd-9497-cbe8c27c47f2-delete_snapshot" released by "delete_snapshot" :: held 2.042s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-f7d2cf9e-1507-49e6-8d95-7e8cffb29989-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:24 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f7d2cf9e-1507-49e6-8d95-7e8cffb29989-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:25 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7" returned: 0 in 0.342s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ec92c6-abce-4a81-9d13-5f9cb72aa03c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:25 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info Sep 07 17:14:25 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:25 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 Sep 07 17:14:25 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:25 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:25 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info is being set with open permissions: ugo+rw Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:25 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info Sep 07 17:14:25 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:25 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" returned: 0 in 0.421s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:25 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989 Sep 07 17:14:25 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:25 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.info" returned: 0 in 0.268s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.264s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:25 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-d9810cbb-1fc6-47af-84c2-b85b5ecf6402 tempest-ProjectReaderTests-1468396590 None] Create snapshot completed successfully Sep 07 17:14:25 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" returned: 0 in 0.286s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f7d2cf9e-1507-49e6-8d95-7e8cffb29989" released by "delete_volume" :: held 0.773s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Created reservations ['06c87ee3-c07e-4fc0-8824-b47abaa7daca', 'c2a4dce6-348c-438e-b956-41f0cd44c77e', '79eef46f-44e2-48ea-9464-7b6829817dde', '5ad17143-8336-4a6c-9587-a7de13a2c0fb'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:25 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:25 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:25 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:26 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:26 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-b94fe1da-bcf0-4c15-b15b-8a9eb7656f92 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f7d2cf9e-1507-49e6-8d95-7e8cffb29989-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-87124394-c186-4438-a53f-0fc6a34732a7-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-87124394-c186-4438-a53f-0fc6a34732a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-87124394-c186-4438-a53f-0fc6a34732a7" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (513b1d19-9a35-48ea-a164-eb9adbeb46d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8535d935-591a-474f-9b78-c3621c394ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8535d935-591a-474f-9b78-c3621c394ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406483094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85565f5-8196-45ef-a3e2-753466ea4d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:27Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e9fe7c-d013-41ab-86e7-14c3e9bdf4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9e9fe7c-d013-41ab-86e7-14c3e9bdf4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a45813f-7eea-42a1-9d77-469ce594271c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a45813f-7eea-42a1-9d77-469ce594271c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c85565f5-8196-45ef-a3e2-753466ea4d02', 'volume_name': 'volume-c85565f5-8196-45ef-a3e2-753466ea4d02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76b599f-3b13-4525-9185-431cb0ba466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d76b599f-3b13-4525-9185-431cb0ba466d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60466a30-4051-48ca-9f13-6234bc96d953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:26 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Volume c85565f5-8196-45ef-a3e2-753466ea4d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c85565f5-8196-45ef-a3e2-753466ea4d02', 'volume_size': 1} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-406483094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c85565f5-8196-45ef-a3e2-753466ea4d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:27Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Creating volume c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:26 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-87124394-c186-4438-a53f-0fc6a34732a7" acquired by "_delete_snapshot" :: waited 0.120s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Deleting offline snapshot 87124394-c186-4438-a53f-0fc6a34732a7 of volume db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:26 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 1073741824 Sep 07 17:14:26 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] snapshot_file for this snap is: volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe786695-bbe4-4d85-ad74-6a5e934f95b6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:26 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:26 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 Sep 07 17:14:26 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:27 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 1073741824" returned: 0 in 0.465s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:27 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7" returned: 0 in 0.409s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1863f6-247b-4a8d-815d-5783544b6bc6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:27 devstack sudo[106951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 Sep 07 17:14:27 devstack sudo[106951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:27 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c Sep 07 17:14:27 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:27 devstack sudo[106951]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60466a30-4051-48ca-9f13-6234bc96d953) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c85565f5-8196-45ef-a3e2-753466ea4d02', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b3ccf1-3246-4b12-b286-c1629ccee2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:27 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Volume volume-c85565f5-8196-45ef-a3e2-753466ea4d02 (c85565f5-8196-45ef-a3e2-753466ea4d02): created successfully Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72b3ccf1-3246-4b12-b286-c1629ccee2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (513b1d19-9a35-48ea-a164-eb9adbeb46d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:27 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4721f76c-f320-4d57-a930-9f9dd2f0dd44 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:14:27 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c" returned: 0 in 0.418s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:27 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:27 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 Sep 07 17:14:27 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:28 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7" returned: 0 in 0.365s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:28 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7 Sep 07 17:14:28 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:28 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c.87124394-c186-4438-a53f-0fc6a34732a7" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-87124394-c186-4438-a53f-0fc6a34732a7" released by "_delete_snapshot" :: held 1.570s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" released by "delete_snapshot" :: held 1.698s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Created reservations ['52162188-3bee-494d-8bb7-c54bca2f4bde', '471872b2-af5f-47e9-a2ca-e18e205b6c4b', 'fb82aedc-a54d-4695-9166-54079fe59731', '5a19fc81-e1d8-4d29-980c-0914f7b781bd'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:28 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Delete snapshot completed successfully. Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2d3272f9-58c7-415c-967b-c5eeab5bebc6 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-87124394-c186-4438-a53f-0fc6a34732a7-delete_snapshot" released by "delete_snapshot" :: held 1.858s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-db87052a-ed44-4fbc-97ec-b4700ef88e4c-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-db87052a-ed44-4fbc-97ec-b4700ef88e4c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ab49d9-3d2d-4dfe-8747-e23948d4edd8]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot f9607a45-afba-4c97-92a1-590db49bf911 of volume c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b8ec8f-d0da-45fa-b415-8c5064a0895d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:28 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:29 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c Sep 07 17:14:29 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:29 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 Sep 07 17:14:29 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:29 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c" returned: 0 in 0.417s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:29 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:29 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c Sep 07 17:14:29 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:29 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 1G Sep 07 17:14:29 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:29 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-db87052a-ed44-4fbc-97ec-b4700ef88e4c" returned: 0 in 0.270s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-db87052a-ed44-4fbc-97ec-b4700ef88e4c" released by "delete_volume" :: held 0.755s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Created reservations ['bfc3ad01-6668-4456-a0e1-aebaae365388', 'bbd6cb16-8afe-40d6-8ae3-64ce202ec5da', '53ebc763-1f82-494d-a924-b6267fa79d7a', '9335402a-f30a-4d61-acbc-60a2ffdca57b'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:29 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:29 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:29 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 1G" returned: 0 in 0.478s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:29 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85565f5-8196-45ef-a3e2-753466ea4d02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:29 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85565f5-8196-45ef-a3e2-753466ea4d02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 Sep 07 17:14:29 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:30 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.316s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:30 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Deleted volume successfully. Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2dd9a41f-4bd5-43df-8025-7b4d33c32b49 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-db87052a-ed44-4fbc-97ec-b4700ef88e4c-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:30 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c85565f5-8196-45ef-a3e2-753466ea4d02 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:30 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 is being set with open permissions: ugo+rw Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:30 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 Sep 07 17:14:30 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:30 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (2b87ae2d-1d04-4cd2-a174-1d2be5e0eeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec656028-4f9b-4f63-be87-47670bf47906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec656028-4f9b-4f63-be87-47670bf47906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400193894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cba0535-dbf2-46d9-898b-f3b2641a7ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:30Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b540b5b-f804-4e82-af7e-8591f2fb4392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b540b5b-f804-4e82-af7e-8591f2fb4392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc811100-aed1-404f-91d6-64d7b889ecbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc811100-aed1-404f-91d6-64d7b889ecbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cba0535-dbf2-46d9-898b-f3b2641a7ad0', 'volume_name': 'volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee95ee0-58a7-46ea-a4cb-975a1df4fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ee95ee0-58a7-46ea-a4cb-975a1df4fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba8597-a4f3-47c2-9298-667d89acc4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:30 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Volume 7cba0535-dbf2-46d9-898b-f3b2641a7ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0', 'volume_size': 1} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:30 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info Sep 07 17:14:30 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:30 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info" returned: 0 in 0.260s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:30 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info is being set with open permissions: ugo+rw Sep 07 17:14:30 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:30 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info Sep 07 17:14:30 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:31 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.info" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.237s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.549s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1400193894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cba0535-dbf2-46d9-898b-f3b2641a7ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:30Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Creating volume 7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:31 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 1073741824 Sep 07 17:14:31 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e9dcabb5-c7cf-44d8-948a-e9ea3cd8a8c7 tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:31 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 1073741824" returned: 0 in 0.454s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:31 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 Sep 07 17:14:31 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:31 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8eba8597-a4f3-47c2-9298-667d89acc4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75cdb57-ea44-4fb0-bb6f-37a7d4498fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Volume volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 (7cba0535-dbf2-46d9-898b-f3b2641a7ad0): created successfully Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f75cdb57-ea44-4fb0-bb6f-37a7d4498fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (2b87ae2d-1d04-4cd2-a174-1d2be5e0eeda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-340f7702-160f-4038-8c8a-67662fe11984 tempest-ProjectReaderTests-1468396590 None] Created volume successfully. Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-f9607a45-afba-4c97-92a1-590db49bf911-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f9607a45-afba-4c97-92a1-590db49bf911-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-f9607a45-afba-4c97-92a1-590db49bf911" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f9607a45-afba-4c97-92a1-590db49bf911" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot f9607a45-afba-4c97-92a1-590db49bf911 of volume c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ac40ac-506b-41b0-8428-0e34f66490fd]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:32 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 Sep 07 17:14:32 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:32 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911" returned: 0 in 0.396s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c85565f5-8196-45ef-a3e2-753466ea4d02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[314ba20e-f94f-4c52-b486-18c45bc4bd90]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:32 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 Sep 07 17:14:32 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Creating offline snapshot ab60b1de-a37a-4867-85a4-7e6b726fa312 of volume 7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b93135-0462-4d69-8d1e-89c875c9899a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:32 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02" returned: 0 in 0.389s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:32 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 Sep 07 17:14:32 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:32 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 Sep 07 17:14:32 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:33 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" returned: 0 in 0.393s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:33 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 1G Sep 07 17:14:33 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:33 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911" returned: 0 in 0.391s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:33 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911 Sep 07 17:14:33 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:33 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02.f9607a45-afba-4c97-92a1-590db49bf911" returned: 0 in 0.279s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:33 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 1G" returned: 0 in 0.435s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f9607a45-afba-4c97-92a1-590db49bf911" released by "_delete_snapshot" :: held 1.601s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" released by "delete_snapshot" :: held 1.631s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:33 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 Sep 07 17:14:33 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Created reservations ['3b3b87b2-1ec9-495c-8898-dcab69d0a4be', '17a483e7-20d3-4094-9569-8aa18d842ce4', 'f4609962-5274-49b6-94c7-f7c8c8876b60', '981c2ebf-d0ae-4502-83b3-5d51c6d83a35'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:33 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:33 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f57eb531-26f3-4e0f-aa82-0dee572c7a5e tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f9607a45-afba-4c97-92a1-590db49bf911-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:34 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312" returned: 0 in 0.329s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:34 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 is being set with open permissions: ugo+rw Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:34 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 Sep 07 17:14:34 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-c85565f5-8196-45ef-a3e2-753466ea4d02-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:34 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312" returned: 0 in 0.244s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c85565f5-8196-45ef-a3e2-753466ea4d02-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:34 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info Sep 07 17:14:34 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[945d54d9-f9fd-47e5-b4ed-40806bed9eb0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:34 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 Sep 07 17:14:34 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:34 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info" returned: 0 in 0.312s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:34 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info is being set with open permissions: ugo+rw Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:34 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info Sep 07 17:14:34 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:34 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02" returned: 0 in 0.429s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:34 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02 Sep 07 17:14:34 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:34 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.info" returned: 0 in 0.293s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.126s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5fc68ed2-be46-4b38-9980-9373920fb418 tempest-ProjectReaderTests-1468396590 None] Create snapshot completed successfully Sep 07 17:14:35 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c85565f5-8196-45ef-a3e2-753466ea4d02" returned: 0 in 0.276s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-c85565f5-8196-45ef-a3e2-753466ea4d02" released by "delete_volume" :: held 0.771s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Created reservations ['873f04b8-c58e-4b15-a8ad-b777db1e706e', '74679023-f83d-4b5a-99c2-28d81e7e8070', '7692b5e4-7aaf-4903-961b-9c857307ef7a', '35e1f689-9aea-411e-a765-97d1a610580d'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:35 devstack sudo[107066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:35 devstack sudo[107066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:35 devstack sudo[107066]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:35 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-c3525a62-50c5-4caa-89f4-774d33bcc265 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-c85565f5-8196-45ef-a3e2-753466ea4d02-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (f498ff5d-b5e7-4661-8d36-8de488713099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1780489-96f0-4aef-b77a-b9c50f777dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1780489-96f0-4aef-b77a-b9c50f777dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189201763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e49028c-6a91-4dda-8ed6-53b69c1b21ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:36Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5065e6c-ab6b-4ffe-8a28-057934bc824b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5065e6c-ab6b-4ffe-8a28-057934bc824b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34eeb6-692d-45ff-a1cd-f81b843e77a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a34eeb6-692d-45ff-a1cd-f81b843e77a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e49028c-6a91-4dda-8ed6-53b69c1b21ee', 'volume_name': 'volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0490495d-b0bf-4d41-a0fc-02a3b15da744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0490495d-b0bf-4d41-a0fc-02a3b15da744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e825640e-7051-4761-b2ae-c05900607f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Volume 1e49028c-6a91-4dda-8ed6-53b69c1b21ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee', 'volume_size': 1} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1189201763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e49028c-6a91-4dda-8ed6-53b69c1b21ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:36Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Creating volume 1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:36 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-ab60b1de-a37a-4867-85a4-7e6b726fa312-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:36 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee 1073741824 Sep 07 17:14:36 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-ab60b1de-a37a-4867-85a4-7e6b726fa312-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-ab60b1de-a37a-4867-85a4-7e6b726fa312" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-ab60b1de-a37a-4867-85a4-7e6b726fa312" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Deleting offline snapshot ab60b1de-a37a-4867-85a4-7e6b726fa312 of volume 7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] snapshot_file for this snap is: volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[54af0f00-4c35-490e-953d-d41f2d71f44b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:36 devstack sudo[107071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 Sep 07 17:14:36 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:36 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee 1073741824" returned: 0 in 0.471s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:36 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda403bf-1a3e-4782-ba58-c2fe65f12635]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:36 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee Sep 07 17:14:36 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:36 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 Sep 07 17:14:36 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:36 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" returned: 0 in 0.259s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e825640e-7051-4761-b2ae-c05900607f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1190c216-39ff-4ca9-990d-aa152c97b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:36 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Volume volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee (1e49028c-6a91-4dda-8ed6-53b69c1b21ee): created successfully Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1190c216-39ff-4ca9-990d-aa152c97b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (f498ff5d-b5e7-4661-8d36-8de488713099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:36 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0c608581-e384-484c-a3bf-443b1d696f6f tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:14:36 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" returned: 0 in 0.384s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:36 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:36 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 Sep 07 17:14:36 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:37 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312" returned: 0 in 0.344s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:37 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312 Sep 07 17:14:37 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:37 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0.ab60b1de-a37a-4867-85a4-7e6b726fa312" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-ab60b1de-a37a-4867-85a4-7e6b726fa312" released by "_delete_snapshot" :: held 1.486s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" released by "delete_snapshot" :: held 1.509s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Created reservations ['c01323b3-12a1-4b74-815e-cb4cfb91d001', '4151f295-7676-4fac-80db-3411e3de8923', 'aa1fc3d5-5871-48f7-b124-abbc6b05d5f2', '988fe378-b840-4a2a-8c4b-9552f58c7e93'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:37 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Delete snapshot completed successfully. Sep 07 17:14:37 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9b96f699-09a9-4716-96cf-be7523447a4c tempest-ProjectReaderTests-1468396590 None] Lock "cinder-ab60b1de-a37a-4867-85a4-7e6b726fa312-delete_snapshot" released by "delete_snapshot" :: held 1.668s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot a2e07806-387b-4011-9c92-f57306a013b0 of volume 1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[418f705e-9d52-4816-803f-79fe0405b8cf]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-7cba0535-dbf2-46d9-898b-f3b2641a7ad0-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-7cba0535-dbf2-46d9-898b-f3b2641a7ad0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:38 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee Sep 07 17:14:38 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f07b3b9-e50d-4412-9648-671c9ca28306]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:38 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 Sep 07 17:14:38 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:38 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:38 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 1G Sep 07 17:14:38 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:38 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:38 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:38 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0 Sep 07 17:14:38 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:39 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:39 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 1G" returned: 0 in 0.480s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-7cba0535-dbf2-46d9-898b-f3b2641a7ad0" released by "delete_volume" :: held 0.788s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:39 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 Sep 07 17:14:39 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Created reservations ['db04f503-f0d9-488d-8d79-5bd678f5c072', '43230ad7-25b6-49a2-8da8-8c4b0b1019e7', 'a7355c90-c358-44f7-a5e7-df770307843a', '466fd00f-e1ec-411e-a7d3-57b372567837'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:39 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:39 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:39 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:39 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 is being set with open permissions: ugo+rw Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:39 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 Sep 07 17:14:39 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:39 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.353s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:39 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Deleted volume successfully. Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-3bc1367c-204f-421a-831a-e6092ee5ac32 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-7cba0535-dbf2-46d9-898b-f3b2641a7ad0-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:39 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0" returned: 0 in 0.325s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:39 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info Sep 07 17:14:39 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:39 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (fcf29b51-f014-4bd8-8e14-846cebc4c183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f758a86d-e8c5-43b6-88e7-1dbaa29874e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f758a86d-e8c5-43b6-88e7-1dbaa29874e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851388812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c8659-e127-4664-b096-ef06e9674d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:40Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd8d9b8-32e4-4219-a548-2fe22d14b42c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bd8d9b8-32e4-4219-a548-2fe22d14b42c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d54fba-bb71-4cc3-83a5-00c8e7a4b2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7d54fba-bb71-4cc3-83a5-00c8e7a4b2bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '223c8659-e127-4664-b096-ef06e9674d23', 'volume_name': 'volume-223c8659-e127-4664-b096-ef06e9674d23', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2caad0d-a1c5-434a-b5cb-009ead32020c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2caad0d-a1c5-434a-b5cb-009ead32020c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf3a4a9-cb6d-4162-8b26-4619c219df71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Volume 223c8659-e127-4664-b096-ef06e9674d23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-223c8659-e127-4664-b096-ef06e9674d23', 'volume_size': 1} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:40 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info" returned: 0 in 0.284s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:40 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info is being set with open permissions: ugo+rw Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:40 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info Sep 07 17:14:40 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:40 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.info" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.289s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-851388812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=223c8659-e127-4664-b096-ef06e9674d23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ac6428774047509f485e12f5a5b51f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:40Z,use_quota=True,user_id='106891fc938c4393a6b1bfee93bbcb20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Creating volume 223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:40 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:40 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 1073741824 Sep 07 17:14:40 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f98d2647-d63f-4fd8-8755-7dd55ec467ee tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:40 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 1073741824" returned: 0 in 0.402s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:40 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 Sep 07 17:14:40 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:41 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf3a4a9-cb6d-4162-8b26-4619c219df71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-223c8659-e127-4664-b096-ef06e9674d23', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a4bbf9-dd2a-411c-a65f-c170019d6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:41 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Volume volume-223c8659-e127-4664-b096-ef06e9674d23 (223c8659-e127-4664-b096-ef06e9674d23): created successfully Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a4bbf9-dd2a-411c-a65f-c170019d6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Flow 'volume_create_manager' (fcf29b51-f014-4bd8-8e14-846cebc4c183) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:41 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-7c30718c-c21c-407a-b1fc-45beae85ae47 tempest-ProjectReaderTests-1468396590 None] Created volume successfully. Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-a2e07806-387b-4011-9c92-f57306a013b0-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-a2e07806-387b-4011-9c92-f57306a013b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-a2e07806-387b-4011-9c92-f57306a013b0" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a2e07806-387b-4011-9c92-f57306a013b0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot a2e07806-387b-4011-9c92-f57306a013b0 of volume 1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f52bc6-64c8-4a46-93c3-78917c2880e5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:41 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 Sep 07 17:14:41 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:41 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0" returned: 0 in 0.357s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e653f6-1a53-4bea-a336-9de1eede74c5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:41 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee Sep 07 17:14:41 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Creating offline snapshot c290687b-f8ea-4c6a-9c24-7cddd3ce4552 of volume 223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:42 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" returned: 0 in 0.386s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5c7412-96a9-47dd-b9bb-33b127d8666d]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:42 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 Sep 07 17:14:42 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:42 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 Sep 07 17:14:42 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:42 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:42 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0 Sep 07 17:14:42 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:42 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23" returned: 0 in 0.434s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:42 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 1G Sep 07 17:14:42 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:42 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee.a2e07806-387b-4011-9c92-f57306a013b0" returned: 0 in 0.255s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-a2e07806-387b-4011-9c92-f57306a013b0" released by "_delete_snapshot" :: held 1.444s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" released by "delete_snapshot" :: held 1.468s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Created reservations ['a4bb75d5-afc5-40d3-8a25-1ff555354a50', 'af2afe08-9f52-4f08-bcef-465cd5040d9e', 'f64b0021-15df-4538-859d-8b7c4d9813e7', 'b566af6f-9e14-4347-b21c-984462b7f2ad'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-16cd8a19-edf9-4e01-9dcb-40754da18005 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-a2e07806-387b-4011-9c92-f57306a013b0-delete_snapshot" released by "delete_snapshot" :: held 1.616s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:43 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 1G" returned: 0 in 0.423s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223c8659-e127-4664-b096-ef06e9674d23 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:43 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223c8659-e127-4664-b096-ef06e9674d23 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 Sep 07 17:14:43 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:43 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-223c8659-e127-4664-b096-ef06e9674d23 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 is being set with open permissions: ugo+rw Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:43 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 Sep 07 17:14:43 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-1e49028c-6a91-4dda-8ed6-53b69c1b21ee-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-1e49028c-6a91-4dda-8ed6-53b69c1b21ee-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" acquired by "delete_volume" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:43 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552" returned: 0 in 0.287s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[45eccabd-580c-45cd-9aef-a2096212d9a0]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:43 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info Sep 07 17:14:43 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:43 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee Sep 07 17:14:43 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:43 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:43 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info is being set with open permissions: ugo+rw Sep 07 17:14:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:44 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info Sep 07 17:14:44 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:44 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:44 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee Sep 07 17:14:44 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:44 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.info" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.052s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-ea36f650-a37f-4398-9558-baa2d13b99b3 tempest-ProjectReaderTests-1468396590 None] Create snapshot completed successfully Sep 07 17:14:44 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-1e49028c-6a91-4dda-8ed6-53b69c1b21ee" released by "delete_volume" :: held 0.682s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Created reservations ['e915235a-026f-4584-a945-78ab5db096c0', 'f4ebff55-c094-463d-899f-c487aba0f0f3', 'b59f243e-5c5c-421a-ab98-eec0dd71794f', '3bd786a7-f91a-46bf-a7bc-1fff3924e047'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:44 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:44 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:44 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.252s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8e12d37f-67cd-4302-9577-83f7f32d3551 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-1e49028c-6a91-4dda-8ed6-53b69c1b21ee-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (31ae0e7c-5db3-40eb-b2c8-68850241ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e39331-05d0-4da2-b01f-43f171b2cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e39331-05d0-4da2-b01f-43f171b2cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306595665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b771d4-efcb-4838-a6a1-04c769660870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:45Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151a299c-88cb-41f5-8e80-2dfe6bd53f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (151a299c-88cb-41f5-8e80-2dfe6bd53f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbda3e-f9f3-4beb-901e-860b57690b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fbbda3e-f9f3-4beb-901e-860b57690b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1b771d4-efcb-4838-a6a1-04c769660870', 'volume_name': 'volume-b1b771d4-efcb-4838-a6a1-04c769660870', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f6cf97-2cf4-4861-b1a8-44c961bc5be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f6cf97-2cf4-4861-b1a8-44c961bc5be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38d63a1-02d3-49d9-93b2-931164f3540d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:45 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Volume b1b771d4-efcb-4838-a6a1-04c769660870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1b771d4-efcb-4838-a6a1-04c769660870', 'volume_size': 1} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:14:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-306595665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1b771d4-efcb-4838-a6a1-04c769660870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c99ebc5a9f0f4a30a1e4122d7e009144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:14:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:14:45Z,use_quota=True,user_id='d3bdc06881f340ea8baae8836416ef80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Creating volume b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:14:45 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:45 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 1073741824 Sep 07 17:14:45 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-c290687b-f8ea-4c6a-9c24-7cddd3ce4552-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-c290687b-f8ea-4c6a-9c24-7cddd3ce4552-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-c290687b-f8ea-4c6a-9c24-7cddd3ce4552" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-c290687b-f8ea-4c6a-9c24-7cddd3ce4552" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Deleting offline snapshot c290687b-f8ea-4c6a-9c24-7cddd3ce4552 of volume 223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] snapshot_file for this snap is: volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cc713e1-e980-42b3-91be-651b8060bafa]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:45 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 Sep 07 17:14:45 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:45 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 1073741824" returned: 0 in 0.438s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:45 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 Sep 07 17:14:45 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:45 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-223c8659-e127-4664-b096-ef06e9674d23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9116a55-72e7-4165-b059-e08eff3ce745]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:45 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 Sep 07 17:14:45 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:45 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870" returned: 0 in 0.257s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:14:45 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a38d63a1-02d3-49d9-93b2-931164f3540d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1b771d4-efcb-4838-a6a1-04c769660870', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b877eb-e444-47e2-8ea6-59e7ff856dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:14:46 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Volume volume-b1b771d4-efcb-4838-a6a1-04c769660870 (b1b771d4-efcb-4838-a6a1-04c769660870): created successfully Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23b877eb-e444-47e2-8ea6-59e7ff856dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Flow 'volume_create_manager' (31ae0e7c-5db3-40eb-b2c8-68850241ec42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:14:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-0b367d33-9b9f-470a-80db-6ebb6737d058 tempest-ProjectMemberTests-1804910109 None] Created volume successfully. Sep 07 17:14:46 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:46 devstack sudo[107251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 Sep 07 17:14:46 devstack sudo[107251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Creating offline snapshot f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb of volume b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8d875b-3661-4d29-82fc-3c3447826831]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:46 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 Sep 07 17:14:46 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:46 devstack sudo[107251]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552" returned: 0 in 0.345s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:46 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552 Sep 07 17:14:46 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:46 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870" returned: 0 in 0.390s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:46 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb 1G Sep 07 17:14:46 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:46 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23.c290687b-f8ea-4c6a-9c24-7cddd3ce4552" returned: 0 in 0.272s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-c290687b-f8ea-4c6a-9c24-7cddd3ce4552" released by "_delete_snapshot" :: held 1.460s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" released by "delete_snapshot" :: held 1.483s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Created reservations ['a8fafb78-3ec9-4022-bfb8-791f1b56a54b', 'a1b5dfd3-3e86-4e5b-9ff8-f2dbed7bee7f', '85853252-f89b-4f9d-b2d7-02959eb19059', '04e2f2b6-1b66-4baa-86e4-413d953baee3'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:46 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Delete snapshot completed successfully. Sep 07 17:14:46 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-384e14fe-d226-4e2c-be9a-4c878e786abc tempest-ProjectReaderTests-1468396590 None] Lock "cinder-c290687b-f8ea-4c6a-9c24-7cddd3ce4552-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:47 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb 1G" returned: 0 in 0.399s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b771d4-efcb-4838-a6a1-04c769660870 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:47 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b771d4-efcb-4838-a6a1-04c769660870 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb Sep 07 17:14:47 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:47 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1b771d4-efcb-4838-a6a1-04c769660870 -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" returned: 0 in 0.290s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:47 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb is being set with open permissions: ugo+rw Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:47 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb Sep 07 17:14:47 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-223c8659-e127-4664-b096-ef06e9674d23-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-223c8659-e127-4664-b096-ef06e9674d23-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e9e923-6fad-40ba-bcef-3effd92df1fc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:47 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" returned: 0 in 0.267s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:47 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 Sep 07 17:14:47 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:47 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info Sep 07 17:14:47 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:47 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:47 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:47 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:48 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info is being set with open permissions: ugo+rw Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:48 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23 Sep 07 17:14:48 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:48 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info Sep 07 17:14:48 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:48 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-223c8659-e127-4664-b096-ef06e9674d23" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:48 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.info" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-quobyte-223c8659-e127-4664-b096-ef06e9674d23" released by "delete_volume" :: held 0.697s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a6d05718-2c61-47bf-9325-1a4133554663 tempest-ProjectMemberTests-1804910109 None] Create snapshot completed successfully Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Created reservations ['ce6b02af-620a-4144-af9c-8c3eff198f97', '08d6dedd-7b0d-4d84-accb-584671ae2b76', '0432a97d-beb4-4370-8948-f4f753e16f1b', '7c7af9a6-6f79-43dc-9dfb-4ff24a3a4c8a'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:48 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:48 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Deleting offline snapshot f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb of volume b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] snapshot_file for this snap is: volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ddf4e9-90dd-470b-a642-bb8e142e851c]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:48 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.275s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:48 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Deleted volume successfully. Sep 07 17:14:48 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-a1fcfd35-2cb6-4712-84fc-cde461b3d153 tempest-ProjectReaderTests-1468396590 None] Lock "cinder-223c8659-e127-4664-b096-ef06e9674d23-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:48 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb Sep 07 17:14:48 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:49 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" returned: 0 in 0.363s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1b771d4-efcb-4838-a6a1-04c769660870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8cf848-b032-4ae9-9d78-147c50b6180e]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:49 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 Sep 07 17:14:49 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:49 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870" returned: 0 in 0.368s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:49 devstack sudo[107304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb Sep 07 17:14:49 devstack sudo[107304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:49 devstack sudo[107304]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" returned: 0 in 0.377s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:49 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:49 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb Sep 07 17:14:49 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:50 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870.f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb" released by "_delete_snapshot" :: held 1.468s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" released by "delete_snapshot" :: held 1.495s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Created reservations ['2fa37b76-a373-4d5a-8eb8-e0ea1210ef66', 'be759239-adad-43a9-b13d-48b257ce5ebb', '76ea41f1-e828-4426-bdae-e17e98b54245', '1dba9fdd-bcfa-4dea-b0e1-b4eaa7ec8f44'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:50 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Delete snapshot completed successfully. Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-2c079b60-8846-49a8-a5fa-3b276c9a4227 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-f5a2275b-9da3-48a0-a8fd-b46ac6ba48bb-delete_snapshot" released by "delete_snapshot" :: held 1.658s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-b1b771d4-efcb-4838-a6a1-04c769660870-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-b1b771d4-efcb-4838-a6a1-04c769660870-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8384723-4553-48bf-b37b-a6a08fd3a8e6]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:14:50 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:50 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 Sep 07 17:14:50 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:51 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:51 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870 Sep 07 17:14:51 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:51 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-b1b771d4-efcb-4838-a6a1-04c769660870" returned: 0 in 0.261s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-quobyte-b1b771d4-efcb-4838-a6a1-04c769660870" released by "delete_volume" :: held 0.700s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Created reservations ['6b738045-41b9-4fb8-b1a3-5350634c2066', 'aa46f45e-0fbf-450f-be1f-981890ac188a', '6dcac480-e165-432f-82ca-f212593beb79', '134a1dc9-63f2-403e-9a67-0cafb2814b53'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:14:51 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:14:51 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:14:51 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.256s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:14:51 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Deleted volume successfully. Sep 07 17:14:51 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-9893eb4b-415f-46a2-9e5b-fa0f0aeb51f4 tempest-ProjectMemberTests-1804910109 None] Lock "cinder-b1b771d4-efcb-4838-a6a1-04c769660870-delete_volume" released by "delete_volume" :: held 1.181s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (11c3c0dd-8ed2-46a9-8e38-7557d5ab5c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05568af7-179f-4bfc-a203-9b9cf2664059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05568af7-179f-4bfc-a203-9b9cf2664059) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349010488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c7940e-28d2-422b-a7fc-1d75bc8dba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:01Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5610a21-2fa7-4dd6-a758-34c3b24b4d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5610a21-2fa7-4dd6-a758-34c3b24b4d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55ed7de-ff50-4860-af18-24d1e4d74fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55ed7de-ff50-4860-af18-24d1e4d74fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c7940e-28d2-422b-a7fc-1d75bc8dba22', 'volume_name': 'volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d3a82e-fa43-4af3-9ed1-8110a4117c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7d3a82e-fa43-4af3-9ed1-8110a4117c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ab44ad-d06b-463a-9ce3-a7e73836f8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:01 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Volume 98c7940e-28d2-422b-a7fc-1d75bc8dba22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22', 'volume_size': 1} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1349010488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c7940e-28d2-422b-a7fc-1d75bc8dba22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:01Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Creating volume 98c7940e-28d2-422b-a7fc-1d75bc8dba22 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:01 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:15:01 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:01 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 1073741824 Sep 07 17:15:01 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:02 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 1073741824" returned: 0 in 0.444s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:02 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 Sep 07 17:15:02 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:02 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8ab44ad-d06b-463a-9ce3-a7e73836f8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8f18ef-f2f9-48a5-ae22-2bdcfe469f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:02 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Volume volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 (98c7940e-28d2-422b-a7fc-1d75bc8dba22): created successfully Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c8f18ef-f2f9-48a5-ae22-2bdcfe469f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (11c3c0dd-8ed2-46a9-8e38-7557d5ab5c99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:02 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-4e6bfc67-e7e2-47dd-b60c-2a3bd534a461 tempest-ProjectReaderTests-2056261291 None] Created volume successfully. Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-98c7940e-28d2-422b-a7fc-1d75bc8dba22-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-98c7940e-28d2-422b-a7fc-1d75bc8dba22-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-quobyte-98c7940e-28d2-422b-a7fc-1d75bc8dba22" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-98c7940e-28d2-422b-a7fc-1d75bc8dba22" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a030a8e-b974-4b17-a8af-f912f0cd71c4]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:02 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:03 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 Sep 07 17:15:03 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:03 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22" returned: 0 in 0.379s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:03 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22 Sep 07 17:15:03 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:03 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-98c7940e-28d2-422b-a7fc-1d75bc8dba22" returned: 0 in 0.247s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-98c7940e-28d2-422b-a7fc-1d75bc8dba22" released by "delete_volume" :: held 0.670s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Created reservations ['05fb06e2-1c6a-4206-8ca4-5ded2a83d377', '017179c4-1dd0-427c-bb97-f46e02588dca', '0c23091b-15e7-495b-9d72-6712ce7be48f', 'd2b3c6e5-4614-442e-9582-fbd2e2a43413'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:03 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:03 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:03 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.251s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:03 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Deleted volume successfully. Sep 07 17:15:03 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-f202f6e7-bc10-41d1-a2e5-ffb40e416d06 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-98c7940e-28d2-422b-a7fc-1d75bc8dba22-delete_volume" released by "delete_volume" :: held 1.128s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (bad4b4e5-54a1-4d53-a6ea-cbc5bd6e2f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f5c684-af73-41be-8549-5e82354e9744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f5c684-af73-41be-8549-5e82354e9744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735057977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:04Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689d1ebc-3530-4faa-8cf0-97469702c660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (689d1ebc-3530-4faa-8cf0-97469702c660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6bfc76-cad3-453e-be2d-baa57dbf62c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba6bfc76-cad3-453e-be2d-baa57dbf62c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b', 'volume_name': 'volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cad6824-9d69-41f8-be79-2ba2f2a38d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cad6824-9d69-41f8-be79-2ba2f2a38d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3071c5a-8b40-4494-8c50-4ae6ada280ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:04 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Volume c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b', 'volume_size': 1} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1735057977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:04Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Creating volume c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:04 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:04 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b 1073741824 Sep 07 17:15:04 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:04 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b 1073741824" returned: 0 in 0.446s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:04 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:05 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b Sep 07 17:15:05 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:05 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" returned: 0 in 0.239s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] <== create_volume: return (723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3071c5a-8b40-4494-8c50-4ae6ada280ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48812bc3-248c-4bac-938e-19fdb7690b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:05 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Volume volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b (c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b): created successfully Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48812bc3-248c-4bac-938e-19fdb7690b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (bad4b4e5-54a1-4d53-a6ea-cbc5bd6e2f4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:05 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-1352720a-f3f8-4535-9322-1a658b841299 tempest-ProjectReaderTests-2056261291 None] Created volume successfully. Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "cinder-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-quobyte-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" acquired by "delete_volume" :: waited 0.016s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ed5fc3-2d1f-4b92-bf09-ee448b6d370b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:05 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b Sep 07 17:15:05 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:05 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" returned: 0 in 0.359s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:05 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:05 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b Sep 07 17:15:05 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:06 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" returned: 0 in 0.263s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b" released by "delete_volume" :: held 0.664s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Created reservations ['b8e40030-247c-4dfb-a3b8-24f4debda8f5', 'b68e4616-90c6-471b-83a9-bf8d350c84d7', '7db44b6d-afb6-41c6-bb95-1a4366b4b7a5', 'dd24f0d0-c4fd-4a69-9233-a84ff97b2c16'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:06 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:06 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:06 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:06 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Deleted volume successfully. Sep 07 17:15:06 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cbef5caa-4c32-4e59-a110-ed7c5e877cbc tempest-ProjectReaderTests-2056261291 None] Lock "cinder-c64d59dc-cc8d-4764-bd6a-7ce335eb4f5b-delete_volume" released by "delete_volume" :: held 1.127s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=191,cinder:INSERT=70,cinder:UPDATE=228,cinder:DELETE=16 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (cc9da2dd-a36b-4e35-b2b5-ea4956ae108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235c8d84-714a-4bb3-8aba-2aff2b374c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=174,cinder:INSERT=61,cinder:UPDATE=258,cinder:DELETE=23 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (235c8d84-714a-4bb3-8aba-2aff2b374c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556886672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8da9ad3-df6d-45bc-b298-7f607920a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:07Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e25851-83ab-4ef0-8957-b566a33ed6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4e25851-83ab-4ef0-8957-b566a33ed6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57861665-b4ad-4fa7-896b-729eaaba10ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57861665-b4ad-4fa7-896b-729eaaba10ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8da9ad3-df6d-45bc-b298-7f607920a4d2', 'volume_name': 'volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ac0760-4f12-4a04-a4f4-fe5a3da23ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4ac0760-4f12-4a04-a4f4-fe5a3da23ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb3d2a2-fc30-44b2-a5a7-442b02235d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Volume a8da9ad3-df6d-45bc-b298-7f607920a4d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2', 'volume_size': 1} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-556886672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8da9ad3-df6d-45bc-b298-7f607920a4d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:07Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Creating volume a8da9ad3-df6d-45bc-b298-7f607920a4d2 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:07 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:07 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 1073741824 Sep 07 17:15:07 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:07 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 1073741824" returned: 0 in 0.406s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:07 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 Sep 07 17:15:07 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:07 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2" returned: 0 in 0.253s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb3d2a2-fc30-44b2-a5a7-442b02235d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e9fc7-53ea-45ce-afd2-bfc4dae21942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:07 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Volume volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 (a8da9ad3-df6d-45bc-b298-7f607920a4d2): created successfully Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257e9fc7-53ea-45ce-afd2-bfc4dae21942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:07 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (cc9da2dd-a36b-4e35-b2b5-ea4956ae108e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:07 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bf04c91d-092e-4c5b-95b6-1380c2b64831 tempest-ProjectReaderTests-2056261291 None] Created volume successfully. Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-a8da9ad3-df6d-45bc-b298-7f607920a4d2-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-a8da9ad3-df6d-45bc-b298-7f607920a4d2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-quobyte-a8da9ad3-df6d-45bc-b298-7f607920a4d2" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-a8da9ad3-df6d-45bc-b298-7f607920a4d2" acquired by "delete_volume" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e3467f-b0f3-4a56-8635-683bc24579bb]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:08 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 Sep 07 17:15:08 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:08 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2" returned: 0 in 0.382s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:08 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2 Sep 07 17:15:08 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:08 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a8da9ad3-df6d-45bc-b298-7f607920a4d2" returned: 0 in 0.245s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-a8da9ad3-df6d-45bc-b298-7f607920a4d2" released by "delete_volume" :: held 0.673s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:08 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Created reservations ['ed14377c-e169-4fad-92db-b51b8c11fc25', '3e07fa7f-a8cc-4cb3-a255-51572930a7b8', '7dd0b47e-ad55-49eb-8c05-0c5911dc150a', 'affce897-f55f-4963-8705-972710cb0747'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:09 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:09 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:09 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.280s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:09 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Deleted volume successfully. Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5c4d71f0-ce63-4f29-8dde-887316b25b25 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-a8da9ad3-df6d-45bc-b298-7f607920a4d2-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:09 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:09 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (2b918bf7-59f4-497f-8a9e-cfc4402879f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dd30ec-4849-453c-ada4-3de6b59df32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7dd30ec-4849-453c-ada4-3de6b59df32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655759133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4685c95-9944-45a9-bc68-6229ffa319b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:10Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8045c29f-214f-43be-ade1-692ca0ae4662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8045c29f-214f-43be-ade1-692ca0ae4662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0336fcf2-d9c7-4541-8009-c3e6c2ed5760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0336fcf2-d9c7-4541-8009-c3e6c2ed5760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4685c95-9944-45a9-bc68-6229ffa319b8', 'volume_name': 'volume-a4685c95-9944-45a9-bc68-6229ffa319b8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34f1251-9b72-47cb-abdb-498f0e511066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e34f1251-9b72-47cb-abdb-498f0e511066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b81090-e8da-4b02-8294-1d5f446cf9cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:09 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Volume a4685c95-9944-45a9-bc68-6229ffa319b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4685c95-9944-45a9-bc68-6229ffa319b8', 'volume_size': 1} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1655759133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4685c95-9944-45a9-bc68-6229ffa319b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40a632acde554039ac688ce0649770fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:10Z,use_quota=True,user_id='444a9787a0db48eabdf3867c6ea68009',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Creating volume a4685c95-9944-45a9-bc68-6229ffa319b8 {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:09 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:15:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:10 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 1073741824 Sep 07 17:15:10 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:10 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 17:15:10 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 1073741824" returned: 0 in 0.455s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:10 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 Sep 07 17:15:10 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:10 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8" returned: 0 in 0.254s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05b81090-e8da-4b02-8294-1d5f446cf9cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4685c95-9944-45a9-bc68-6229ffa319b8', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbab5f7-1007-4884-8db8-ed88268daf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:10 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Volume volume-a4685c95-9944-45a9-bc68-6229ffa319b8 (a4685c95-9944-45a9-bc68-6229ffa319b8): created successfully Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbab5f7-1007-4884-8db8-ed88268daf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Flow 'volume_create_manager' (2b918bf7-59f4-497f-8a9e-cfc4402879f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:10 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-9df587ed-95d4-4363-9c7b-b794d487aa19 tempest-ProjectReaderTests-2056261291 None] Created volume successfully. Sep 07 17:15:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-a4685c95-9944-45a9-bc68-6229ffa319b8-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:11 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-a4685c95-9944-45a9-bc68-6229ffa319b8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "cinder-quobyte-a4685c95-9944-45a9-bc68-6229ffa319b8" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-a4685c95-9944-45a9-bc68-6229ffa319b8" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f45e71f-04d9-400b-a009-43e4aa005d53]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:12 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 Sep 07 17:15:12 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:12 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8" returned: 0 in 0.370s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:12 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8 Sep 07 17:15:12 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:12 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-a4685c95-9944-45a9-bc68-6229ffa319b8" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-quobyte-a4685c95-9944-45a9-bc68-6229ffa319b8" released by "delete_volume" :: held 0.669s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Created reservations ['76573b1b-6d27-4c72-a6ef-a1f9c07fb67e', '1479f0c7-140e-48e8-a718-818b414d5800', '8888074f-d5ab-4580-9891-1eea9aebb55a', '5089556d-d089-401d-8564-3e288f8eafc1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:12 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:12 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:12 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:13 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:13 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.258s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:13 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:13 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Deleted volume successfully. Sep 07 17:15:13 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-cecfc078-c3e2-4a9d-8b18-edabc8c71ee7 tempest-ProjectReaderTests-2056261291 None] Lock "cinder-a4685c95-9944-45a9-bc68-6229ffa319b8-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:22 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=11,cinder:INSERT=7,cinder:UPDATE=24 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:15:23 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=19,cinder:SELECT=15,cinder:DELETE=4,cinder:INSERT=3 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Flow 'volume_create_manager' (219c5bc6-167a-4b58-b2ca-a6f3c3df9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b04e18-905f-450b-8868-8d55524e63bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83b04e18-905f-450b-8868-8d55524e63bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-355542231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4aaa7e-06b0-4823-9b76-2363b1001d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4b8f04f4248489d51ed9dde8c1e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:31Z,use_quota=True,user_id='72e9eab5a90045b4a79288bd4ea792bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36f42a3-e300-49b6-9151-547b782eac57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e36f42a3-e300-49b6-9151-547b782eac57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444cd75f-fccc-46dd-8ad4-ea6759f052ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (444cd75f-fccc-46dd-8ad4-ea6759f052ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a4aaa7e-06b0-4823-9b76-2363b1001d0d', 'volume_name': 'volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f4f8eb-4ccb-41a2-8212-0a68704dd973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f4f8eb-4ccb-41a2-8212-0a68704dd973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14434b6c-0cea-47f9-b91c-73f597c9b923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Volume 2a4aaa7e-06b0-4823-9b76-2363b1001d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d', 'volume_size': 1} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-355542231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a4aaa7e-06b0-4823-9b76-2363b1001d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4b8f04f4248489d51ed9dde8c1e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:31Z,use_quota=True,user_id='72e9eab5a90045b4a79288bd4ea792bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)}" {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Creating volume 2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:31 devstack cinder-volume[86783]: INFO cinder.volume.drivers.remotefs [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] casted to osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d 1073741824 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:31 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d 1073741824 Sep 07 17:15:31 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:31 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d 1073741824" returned: 0 in 0.388s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:31 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:31 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:31 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] <== create_volume: return (681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'} {{(pid=86783) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14434b6c-0cea-47f9-b91c-73f597c9b923) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d', 'volume_size': 1}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c0562-092d-4624-97c0-0b9037e76067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:31 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Volume volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d (2a4aaa7e-06b0-4823-9b76-2363b1001d0d): created successfully Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c0c0562-092d-4624-97c0-0b9037e76067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:31 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Flow 'volume_create_manager' (219c5bc6-167a-4b58-b2ca-a6f3c3df9f37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:31 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-e7adb6b2-0c84-44c3-944d-54eb9d5ca8d5 tempest-SnapshotDependencyTests-1701938140 None] Created volume successfully. Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Creating offline snapshot 12250bd3-aa62-426f-bcc6-a9290d0fd2f2 of volume 2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87134ce-48d6-4e90-890d-c25f0cb957e5]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:32 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:32 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:32 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:32 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 1G {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:32 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 1G Sep 07 17:15:32 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:33 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 1G" returned: 0 in 0.373s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:33 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:33 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:33 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d -F qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.292s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 is being set with open permissions: ugo+rw Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:33 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:33 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:33 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.238s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:33 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info Sep 07 17:15:33 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:33 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info" returned: 0 in 0.246s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:33 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info is being set with open permissions: ugo+rw Sep 07 17:15:33 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:33 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info Sep 07 17:15:33 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:34 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.info" returned: 0 in 0.248s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:34 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.827s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:34 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-95c3880c-fc4e-46ca-88c4-3eccd429181e tempest-SnapshotDependencyTests-1701938140 None] Create snapshot completed successfully Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86783) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Flow 'volume_create_manager' (5e7d19f8-d142-4436-a9ab-771541224492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5407c151-1028-4191-b2a0-80c296f59d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5407c151-1028-4191-b2a0-80c296f59d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T15:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f692cf5-b1a5-4ef5-9b05-6feba76f18a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dc4b8f04f4248489d51ed9dde8c1e90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T15:15:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=12250bd3-aa62-426f-bcc6-a9290d0fd2f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T15:15:35Z,use_quota=True,user_id='72e9eab5a90045b4a79288bd4ea792bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bd3e3e95-b820-492f-8ec6-a1167975b275),volume_type_id=bd3e3e95-b820-492f-8ec6-a1167975b275)' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e35cfd-d28d-431b-83b2-ad291bb6dd65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41e35cfd-d28d-431b-83b2-ad291bb6dd65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006256ca-ea32-4dfb-a916-0827f172cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006256ca-ea32-4dfb-a916-0827f172cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '8f692cf5-b1a5-4ef5-9b05-6feba76f18a4', 'volume_name': 'volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4', 'volume_size': 1, 'snapshot_id': '12250bd3-aa62-426f-bcc6-a9290d0fd2f2'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e874dff2-d58c-4184-aca7-349d685b80b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e874dff2-d58c-4184-aca7-349d685b80b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9140c090-9e49-4eb0-a4d2-bc9bbca6c387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:35 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Volume 8f692cf5-b1a5-4ef5-9b05-6feba76f18a4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4', 'volume_size': 1, 'snapshot_id': '12250bd3-aa62-426f-bcc6-a9290d0fd2f2'} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" by "_create_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Creating volume 8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 from snapshot 12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Selected osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7 as target Quobyte volume. {{(pid=86783) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" by "_copy_volume_from_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] snapshot: 12250bd3-aa62-426f-bcc6-a9290d0fd2f2, volume: 8f692cf5-b1a5-4ef5-9b05-6feba76f18a4, {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eaddb9-1986-41b1-b62f-e78f73510dbc]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:35 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:35 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:35 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.350s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc608c7-ff79-4bcd-8b67-653ffa09ed59]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:35 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:35 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:35 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.349s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] will copy from snapshot at /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Creating direct copy from snapshot {{(pid=86783) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG cinder.utils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Path /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 not found in is_blk_device check {{(pid=86783) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 17:15:35 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:35 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 Sep 07 17:15:35 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:39 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" returned: 0 in 3.963s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:39 devstack cinder-volume[86783]: DEBUG cinder.image.image_utils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Image conversion details: src /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d, size 1024.00 MB, duration 3.97 sec, destination /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 {{(pid=86783) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 17:15:39 devstack cinder-volume[86783]: INFO cinder.image.image_utils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Converted 1024.00 MB image at 258.26 MB/s Sep 07 17:15:39 devstack cinder-volume[86783]: WARNING cinder.volume.drivers.remotefs [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 is being set with open permissions: ugo+rw Sep 07 17:15:39 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:39 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 Sep 07 17:15:39 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:40 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" released by "_copy_volume_from_snapshot" :: held 4.975s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" released by "_create_volume_from_snapshot" :: held 5.035s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.048s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9140c090-9e49-4eb0-a4d2-bc9bbca6c387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4', 'volume_size': 1, 'snapshot_id': '12250bd3-aa62-426f-bcc6-a9290d0fd2f2'}' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bebfcd-e824-4ab0-91f3-dac5fe33359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 17:15:40 devstack cinder-volume[86783]: INFO cinder.volume.flows.manager.create_volume [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Volume volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 (8f692cf5-b1a5-4ef5-9b05-6feba76f18a4): created successfully Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bebfcd-e824-4ab0-91f3-dac5fe33359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86783) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Flow 'volume_create_manager' (5e7d19f8-d142-4436-a9ab-771541224492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86783) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 17:15:40 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-bc5f5d65-c456-425e-ad63-b631c6e09282 tempest-SnapshotDependencyTests-1701938140 None] Created volume successfully. Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-delete_snapshot" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" by "delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2" by "_delete_snapshot" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Deleting offline snapshot 12250bd3-aa62-426f-bcc6-a9290d0fd2f2 of volume 2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] snapshot_file for this snap is: volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[2491fdd6-4e59-478a-9c25-9842f7ff0a2a]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:40 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:40 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:40 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.343s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.remotefs [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86783) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf97eeb6-43da-44bc-ab69-6669ad6b80c8]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:40 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:41 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:41 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:41 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.514s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:41 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:41 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:41 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.314s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:41 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:41 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2 Sep 07 17:15:41 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:42 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d.12250bd3-aa62-426f-bcc6-a9290d0fd2f2" returned: 0 in 0.240s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-12250bd3-aa62-426f-bcc6-a9290d0fd2f2" released by "_delete_snapshot" :: held 1.497s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" released by "delete_snapshot" :: held 1.519s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Created reservations ['317c3078-43fb-4d3f-a670-56263942a252', '9caeee55-606f-4e61-b8e5-7c1dcb226593', '7eec03f1-7a94-4348-973a-1b300485fd6b', 'f998c598-6629-4f57-9692-a93af819ebc1'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:42 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Delete snapshot completed successfully. Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-8fb5ae2e-dc42-43fb-9656-0fae7230e8ad tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-12250bd3-aa62-426f-bcc6-a9290d0fd2f2-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-2a4aaa7e-06b0-4823-9b76-2363b1001d0d-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-2a4aaa7e-06b0-4823-9b76-2363b1001d0d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" acquired by "delete_volume" :: waited 0.018s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6bd9da-3c81-4668-99bc-92cf4bf12fc7]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:42 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:42 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:42 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:43 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.358s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:43 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d Sep 07 17:15:43 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:43 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" returned: 0 in 0.249s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-2a4aaa7e-06b0-4823-9b76-2363b1001d0d" released by "delete_volume" :: held 0.674s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Created reservations ['c872813a-a3ec-466a-9407-f0fd5ec027ac', 'ea05fb65-2704-4cdd-b619-6d06e6ba1192', 'be5a2f74-c0ec-41d8-8f9b-e0052056b978', 'e34f973a-ab45-4984-a702-c902a57c1dde'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:43 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:43 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:43 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.242s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:43 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Deleted volume successfully. Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-86c44438-1f20-4bc3-829a-83abaab61c96 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-2a4aaa7e-06b0-4823-9b76-2363b1001d0d-delete_volume" released by "delete_volume" :: held 1.102s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4-delete_volume" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" by "delete_volume" {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" acquired by "delete_volume" :: waited 0.014s {{(pid=86783) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bbe0327-5259-4714-aff9-40ce8118349b]: (4, 'qcow2') {{(pid=89052) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 17:15:43 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:44 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 Sep 07 17:15:44 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:44 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" returned: 0 in 0.361s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:44 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4 Sep 07 17:15:44 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:44 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c/volume-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" returned: 0 in 0.241s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-quobyte-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4" released by "delete_volume" :: held 0.641s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.quota [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Created reservations ['d006a41f-752a-4d3d-80e2-a737282c4f45', '0668fc75-dc66-4582-b7c1-3c4be84e13f3', '62c20970-596c-4c68-8dc8-2081264bbfb9', 'd54aad59-7210-418a-a457-328720bb5ffa'] {{(pid=86783) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:15:44 devstack sudo[107562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:15:44 devstack sudo[107562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:15:44 devstack sudo[107562]: pam_unix(sudo:session): session closed for user root Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.262s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:15:44 devstack cinder-volume[86783]: INFO cinder.volume.manager [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Deleted volume successfully. Sep 07 17:15:44 devstack cinder-volume[86783]: DEBUG cinder.coordination [None req-5d5d57bb-1baa-40df-a9ad-951134c0e987 tempest-SnapshotDependencyTests-1701938140 None] Lock "cinder-8f692cf5-b1a5-4ef5-9b05-6feba76f18a4-delete_volume" released by "delete_volume" :: held 1.090s {{(pid=86783) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 17:15:54 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:UPDATE=31,cinder:SELECT=29,cinder:DELETE=1,cinder:INSERT=6 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:15:54 devstack cinder-volume[86783]: DEBUG dbcounter [-] [86783] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7': None} {{(pid=86783) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG cinder.volume.drivers.quobyte [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-569789b8-6f73-4d81-8177-1ce86a6897c7'] {{(pid=86783) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.lockutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86783) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 17:16:09 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 17:16:09 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c Sep 07 17:16:09 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 17:16:10 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 07 17:16:10 devstack cinder-volume[86783]: DEBUG oslo_concurrency.processutils [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/210b09a00482fc7ed1329c371b73002c" returned: 0 in 0.250s {{(pid=86783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 17:16:10 devstack cinder-volume[86783]: DEBUG cinder.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Notifying Schedulers of capabilities ... {{(pid=86783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 17:16:10 devstack cinder-volume[86783]: DEBUG oslo_service.periodic_task [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] Running periodic task VolumeManager._thread_info {{(pid=86783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 17:16:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread count: 28 {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 17:16:10 devstack cinder-volume[86783]: DEBUG cinder.volume.manager [None req-be6fc964-6dd4-49d2-ac1b-0594977d91d8 None None] thread info: [<_MainThread(MainThread, started 124809656250496)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}